00010000:00010000:2.0F:1784584111.729304:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584111.789607:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784584111.789626:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599218304:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784584111.789688:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0F:1784584111.789741:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599218304 00000100:00100000:3.0:1784584111.789757:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599218304 00000100:00100000:3.0:1784584111.789817:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784584111.789827:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599218304:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0F:1784584111.789830:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30484f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599218432:0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784584111.789863:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1784584111.789871:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584111.789915:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599218432 00000100:00100000:0.0:1784584111.789919:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599218432 00000100:00100000:0.0:1784584111.789941:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784584111.789946:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599218304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584111.789952:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599218432:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784584111.789961:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000004:00000024:0.0:1784584111.789976:0:17192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1784584111.790013:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599218304:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784584111.790020:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599218432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584111.790029:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784584111.790063:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30484f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599218432:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1784584112.691233:0:17939:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784584112.749994:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584113.250572:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584113.250692:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580280448 00000100:00100000:3.0:1784584113.250702:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580280448 00000100:00100000:3.0:1784584113.250759:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 166 00000100:00100000:3.0:1784584113.250769:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+13:2401:x1871271580280448:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784584113.250839:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+13:2401:x1871271580280448:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 71us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584113.250847:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 166 00000100:00100000:0.0:1784584113.251015:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584113.251055:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584113.251077:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584113.251094:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584113.251123:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584113.251142:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584113.251157:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584113.251174:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584113.251704:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580280704 00000100:00100000:2.0:1784584113.251711:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580280704 00000100:00100000:2.0:1784584113.251750:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580281216 00000100:00100000:2.0:1784584113.251753:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580281216 00000100:00100000:2.0:1784584113.251764:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580280576 00000100:00100000:2.0:1784584113.251767:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580280576 00000100:00100000:2.0:1784584113.251777:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580281088 00000100:00100000:2.0:1784584113.251779:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580281088 00000100:00100000:2.0:1784584113.251793:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 57 00000100:00100000:2.0:1784584113.251800:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:2401:x1871271580280704:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784584113.251846:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:2401:x1871271580280704:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 47us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584113.251854:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 57 00000100:00100000:2.0:1784584113.251868:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 58 00000100:00100000:2.0:1784584113.251874:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec83902b-e7e6-476f-9537-00c010e7ce56+5:2401:x1871271580281216:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784584113.251898:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec83902b-e7e6-476f-9537-00c010e7ce56+5:2401:x1871271580281216:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 24us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584113.251904:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 58 00000100:00100000:2.0:1784584113.251915:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 59 00000100:00100000:2.0:1784584113.251922:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+22:2401:x1871271580280576:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784584113.251947:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+22:2401:x1871271580280576:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 26us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584113.251953:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 59 00000100:00100000:2.0:1784584113.251974:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 60 00000100:00100000:2.0:1784584113.251980:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec83902b-e7e6-476f-9537-00c010e7ce56+6:2401:x1871271580281088:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784584113.252004:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec83902b-e7e6-476f-9537-00c010e7ce56+6:2401:x1871271580281088:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 24us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584113.252009:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 60 00000100:00080000:2.0:1784584113.252028:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784584113.252031:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784584113.252251:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580280960 00000100:00100000:3.0:1784584113.252256:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580280960 00000100:00100000:3.0:1784584113.252281:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580281472 00000100:00100000:3.0:1784584113.252284:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580281472 00000100:00100000:3.0:1784584113.252295:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580280832 00000100:00100000:3.0:1784584113.252297:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580280832 00000100:00100000:3.0:1784584113.252308:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580281344 00000100:00100000:3.0:1784584113.252310:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580281344 00000100:00100000:3.0:1784584113.252325:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00100000:3.0:1784584113.252331:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:2401:x1871271580280960:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784584113.252363:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:2401:x1871271580280960:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 32us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584113.252377:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00100000:3.0:1784584113.252390:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 22 00000100:00100000:3.0:1784584113.252397:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec83902b-e7e6-476f-9537-00c010e7ce56+5:2401:x1871271580281472:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784584113.252423:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec83902b-e7e6-476f-9537-00c010e7ce56+5:2401:x1871271580281472:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 27us (1328us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584113.252429:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 22 00000100:00100000:3.0:1784584113.252439:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 23 00000100:00100000:3.0:1784584113.252444:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:2401:x1871271580280832:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784584113.252461:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:2401:x1871271580280832:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 17us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584113.252486:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 23 00000100:00100000:3.0:1784584113.252498:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 24 00000100:00100000:3.0:1784584113.252503:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec83902b-e7e6-476f-9537-00c010e7ce56+5:2401:x1871271580281344:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784584113.252522:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec83902b-e7e6-476f-9537-00c010e7ce56+5:2401:x1871271580281344:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 19us (1347us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584113.252527:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 24 00000100:00080000:2.0:1784584113.252784:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784584113.252788:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784584113.326751:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599218560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784584113.326817:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584113.326881:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599218560 00000100:00100000:2.0:1784584113.326888:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599218560 00000100:00100000:2.0:1784584113.326940:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784584113.326949:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599218560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784584113.326978:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1784584113.327019:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599218560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584113.327026:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1784584113.327046:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784584113.327087:0:3640:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:2.0:1784584113.327092:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98b43c8ed500, transno 8589934596 00000004:00080000:2.0:1784584113.327102:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:2.0:1784584113.327138:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599218560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784584113.327631:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599218688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784584113.327666:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584113.328560:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599218688 00000100:00100000:2.0:1784584113.328569:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599218688 00000100:00100000:2.0:1784584113.328622:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784584113.328641:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599218688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784584113.328670:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784584113.328725:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599218688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584113.328732:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784584113.328778:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599218688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784584113.328982:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599218944:0@lo:400:kworker.0 00000100:00100000:2.0:1784584113.329015:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584113.329045:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599219456:0@lo:400:kworker.0 00000100:00100000:2.0:1784584113.329068:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584113.329085:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1871271599219968:0@lo:400:kworker.0 00000100:00100000:2.0:1784584113.329123:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584113.329142:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1784584113.329147:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599219072:0@lo:400:kworker.0 00000100:00100000:2.0:1784584113.329167:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584113.329184:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599219584:0@lo:400:kworker.0 00000100:00100000:2.0:1784584113.329205:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584113.329219:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1871271599220096:0@lo:400:kworker.0 00000100:00100000:2.0:1784584113.329242:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584113.329263:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599219968 00000100:00100000:2.0:1784584113.329267:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599219968 00000100:00100000:2.0:1784584113.329288:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599219072 00000100:00100000:2.0:1784584113.329290:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599219072 00000100:00100000:2.0:1784584113.329299:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599219584 00000100:00100000:2.0:1784584113.329301:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599219584 00000100:00100000:2.0:1784584113.329311:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599220096 00000100:00100000:2.0:1784584113.329321:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599220096 00000100:00100000:2.0:1784584113.329339:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784584113.329345:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1871271599219968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584113.329382:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1871271599219968:12345-0@lo:400:kworker.0 Request processed in 37us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584113.329389:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784584113.329401:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784584113.329407:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599219072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584113.329431:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599219072:12345-0@lo:400:kworker.0 Request processed in 24us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584113.329437:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784584113.329447:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784584113.329452:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599219584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584113.329575:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784584113.329585:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1871271599220096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584113.329622:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1871271599220096:12345-0@lo:400:kworker.0 Request processed in 38us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584113.329629:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1784584113.329651:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784584113.329656:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784584113.329666:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784584113.333835:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599219584:12345-0@lo:400:kworker.0 Request processed in 4378us (4624us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584113.333846:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784584113.333900:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3642:1871271599218816:0@lo:400:kworker.0 00000100:00100000:2.0:1784584113.333941:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584113.333971:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599219328:0@lo:400:kworker.0 00000100:00100000:2.0:1784584113.333994:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584113.334022:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1871271599219840:0@lo:400:kworker.0 00000100:00100000:2.0:1784584113.334045:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584113.334065:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1784584113.334071:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599219200:0@lo:400:kworker.0 00000100:00100000:2.0:1784584113.334095:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584113.334138:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1871271599219712:0@lo:400:kworker.0 00000100:00100000:2.0:1784584113.334161:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584113.334176:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30484dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599220224:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784584113.334201:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584113.334235:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599220224 00000100:00100000:2.0:1784584113.334243:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599220224 00000100:00100000:2.0:1784584113.334288:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784584113.334296:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599220224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784584113.334312:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1784584113.334348:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599220224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584113.334354:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784584113.334402:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599219072:0@lo:400:kworker.0 00000100:00100000:2.0:1784584113.334414:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599219584:0@lo:400:kworker.0 00010000:00080000:2.0:1784584113.334428:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303850000 x1871271599220096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584113.334439:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1871271599220096:0@lo:400:kworker.0 00000100:00100000:2.0:1784584113.334452:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1871271599219968:0@lo:400:kworker.0 00000100:00100000:2.0:1784584113.334524:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30484dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599220224:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784584113.334967:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599218816 00000100:00100000:0.0:1784584113.334973:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599218816 00000100:00100000:0.0:1784584113.335006:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1784584113.335013:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:3642:x1871271599218816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584113.335059:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:3642:x1871271599218816:12345-0@lo:400:kworker.0 Request processed in 46us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584113.335066:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1784584113.335093:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599218944 00000100:00100000:0.0:1784584113.335097:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599218944 00000100:00100000:0.0:1784584113.335130:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599219200 00000100:00100000:0.0:1784584113.335133:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599219200 00000100:00100000:0.0:1784584113.335147:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784584113.335153:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599218944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584113.335192:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599218944:12345-0@lo:400:kworker.0 Request processed in 38us (6176us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584113.335198:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784584113.335211:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784584113.335217:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599219200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584113.335245:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599219200:12345-0@lo:400:kworker.0 Request processed in 28us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584113.335250:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784584113.335273:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599219840 00000100:00100000:0.0:1784584113.335277:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599219840 00000100:00100000:0.0:1784584113.335302:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599219712 00000100:00100000:0.0:1784584113.335306:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599219712 00000100:00100000:0.0:1784584113.335326:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784584113.335331:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871271599219840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584113.335374:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871271599219840:12345-0@lo:400:kworker.0 Request processed in 42us (1328us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584113.335381:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784584113.335394:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784584113.335400:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871271599219712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584113.335428:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871271599219712:12345-0@lo:400:kworker.0 Request processed in 29us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584113.335433:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1784584113.335452:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784584113.335940:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784584113.335943:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784584113.335979:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599219200:0@lo:400:kworker.0 00000100:00100000:0.0:1784584113.335991:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1871271599219712:0@lo:400:kworker.0 00000100:00100000:0.0:1784584113.336001:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3642:1871271599218816:0@lo:400:kworker.0 00010000:00080000:0.0:1784584113.336013:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303852300 x1871271599219840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584113.336022:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1871271599219840:0@lo:400:kworker.0 00000100:00100000:0.0:1784584113.336057:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599218944:0@lo:400:kworker.0 00000100:00100000:3.0:1784584113.336532:0:19378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599219456 00000100:00100000:3.0:1784584113.336538:0:19378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599219456 00000100:00100000:3.0:1784584113.336736:0:19378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599219328 00000100:00100000:3.0:1784584113.336740:0:19378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599219328 00000100:00100000:3.0:1784584113.336766:0:19378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784584113.336773:0:19378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599219456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584113.336859:0:19378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599219456:12345-0@lo:400:kworker.0 Request processed in 86us (7790us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584113.336866:0:19378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784584113.336882:0:19378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784584113.336888:0:19378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599219328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584113.336922:0:19378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599219328:12345-0@lo:400:kworker.0 Request processed in 34us (2927us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584113.336929:0:19378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1784584113.337961:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784584113.338003:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599219456:0@lo:400:kworker.0 00000100:00100000:0.0:1784584113.338039:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599219328:0@lo:400:kworker.0 00000001:00080000:2.0:1784584113.346708:0:17166:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:2.0:1784584113.346729:0:17166:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98b40a6fd900 refcount 2 committed 0 result 0 batchid 4294967530 00000020:00080000:2.0:1784584113.346734:0:17166:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98b43c915c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98b40a6fdf00 00000020:00080000:2.0:1784584113.346738:0:17166:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff98b43c915500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98b43fe3d200 00000020:00080000:2.0:1784584113.346776:0:17226:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 8 00000020:00080000:2.0:1784584113.346846:0:17226:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1784584113.348632:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e49226 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584113.348648:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e49226 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584113.348656:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e49226 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584113.348662:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982600 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784584113.348667:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e49226 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584113.348675:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e49226 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584113.348695:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98b303986f00) 00010000:00010000:3.0:1784584113.348697:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584113.348702:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e49226 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584113.348708:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b418982600/0xdab2421a42e49226 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584113.438869:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584113.440641:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580281600 00000100:00100000:2.0:1784584113.440660:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580281600 00000100:00100000:2.0:1784584113.440717:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 65 00000100:00100000:2.0:1784584113.440727:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+13:15603:x1871271580281600:12345-192.168.203.51@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1784584113.440835:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+13:15603:x1871271580281600:12345-192.168.203.51@tcp:60:lhsmtool_posix.0 Request processed in 109us (1977us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584113.440842:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 65 00000100:00100000:3.0:1784584113.449824:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584113.449917:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580281728 00000100:00100000:2.0:1784584113.449927:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580281728 00000100:00100000:2.0:1784584113.449988:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 66 00000100:00100000:2.0:1784584113.449998:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:15603:x1871271580281728:12345-192.168.203.51@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1784584113.450098:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:15603:x1871271580281728:12345-192.168.203.51@tcp:60:lhsmtool_posix.0 Request processed in 100us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584113.450119:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 66 00000100:00100000:2.0:1784584113.455374:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584113.455416:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580281984 00000100:00100000:2.0:1784584113.455425:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580281984 00000100:00100000:2.0:1784584113.455629:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 12 00000100:00100000:2.0:1784584113.455640:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+13:15603:x1871271580281984:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784584113.455841:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+14:15603:x1871271580281984:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 Request processed in 203us (474us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1784584113.455850:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 12 00010000:00010000:2.0:1784584113.781223:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584114.797800:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584115.822105:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584115.886235:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784584115.886259:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30405fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599220352:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784584115.886324:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584115.886431:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599220352 00000100:00100000:2.0:1784584115.886438:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599220352 00000100:00080000:1.0F:1784584115.886488:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784584115.886528:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784584115.886538:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599220352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784584115.886567:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784584115.886622:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599220352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584115.886630:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784584115.886659:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30405fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599220352:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1784584116.845791:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584116.909654:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784584116.909682:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30484c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599220480:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784584116.909742:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584116.909793:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599220480 00000100:00100000:0.0:1784584116.909799:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599220480 00000100:00100000:0.0:1784584116.909840:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784584116.909849:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599220480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784584116.909880:0:17192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784584116.909918:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599220480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584116.909925:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784584116.909970:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30484c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599220480:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784584116.914389:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784584116.914412:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30405d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599220608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784584116.914505:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584116.914638:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599220608 00000100:00100000:2.0:1784584116.914646:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599220608 00000100:00100000:2.0:1784584116.914689:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784584116.914698:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599220608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784584116.914730:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1784584116.914775:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599220608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584116.914781:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784584116.914863:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30405d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599220608:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1784584117.078826:0:20561:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 17:48:36 (1784584116) 00010000:00010000:3.0:1784584117.870129:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584118.364066:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584118.364116:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584118.364151:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584118.364241:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580282368 00000100:00100000:1.0:1784584118.364250:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580282368 00000100:00100000:1.0:1784584118.364314:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580282240 00000100:00100000:1.0:1784584118.364318:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580282240 00000100:00100000:1.0:1784584118.364341:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 67 00000100:00100000:1.0:1784584118.364350:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:2400:x1871271580282368:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784584118.364441:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:2400:x1871271580282368:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 92us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584118.364450:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 67 00000100:00100000:1.0:1784584118.364489:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 68 00000100:00100000:1.0:1784584118.364497:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+14:2400:x1871271580282240:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784584118.364526:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+14:2400:x1871271580282240:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 30us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584118.364531:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 68 00000100:00100000:3.0:1784584118.365147:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580282112 00000100:00100000:3.0:1784584118.365154:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580282112 00000100:00100000:3.0:1784584118.365197:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 168 00000100:00100000:3.0:1784584118.365205:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+13:2400:x1871271580282112:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784584118.365247:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+13:2400:x1871271580282112:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 43us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584118.365254:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 168 00000100:00080000:2.0:1784584118.366437:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784584118.366444:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784584118.378827:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584118.378860:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584118.378991:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580282624 00000100:00100000:0.0:1784584118.378999:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580282624 00000100:00100000:0.0:1784584118.379060:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580282496 00000100:00100000:0.0:1784584118.379062:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580282496 00000100:00100000:0.0:1784584118.379093:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 27 00000100:00100000:0.0:1784584118.379103:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:2401:x1871271580282624:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784584118.379168:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:2401:x1871271580282624:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 66us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584118.379176:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 27 00000100:00100000:0.0:1784584118.379191:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 26 00000100:00100000:0.0:1784584118.379197:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:2397:x1871271580282496:12345-192.168.203.51@tcp:9:kworker.0 00000020:00000080:0.0:1784584118.379212:0:18694:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48f55 00000100:00080000:0.0:1784584118.379224:0:18694:0:(import.c:65:import_set_state_nolock()) ffff98b302b96800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784584118.379260:0:18694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1784584118.379360:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+2:2397:x1871271580282496:12345-192.168.203.51@tcp:9:kworker.0 Request processed in 163us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584118.379379:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 26 00010000:00010000:3.0:1784584118.379610:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784584118.380666:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784584118.380673:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784584118.386152:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584118.386549:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584118.386602:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584118.386625:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584118.386649:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580283008 00000100:00100000:2.0:1784584118.386659:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580283008 00000100:00100000:2.0:1784584118.386707:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580283136 00000100:00100000:2.0:1784584118.386711:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580283136 00000100:00100000:2.0:1784584118.386734:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 27 00000100:00100000:2.0:1784584118.386743:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec83902b-e7e6-476f-9537-00c010e7ce56+5:2397:x1871271580283008:12345-192.168.203.51@tcp:9:kworker.0 00000020:00000080:2.0:1784584118.386778:0:18692:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48f94 00000100:00080000:2.0:1784584118.386788:0:18692:0:(import.c:65:import_set_state_nolock()) ffff98b43c23b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784584118.386834:0:18692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1784584118.387126:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec83902b-e7e6-476f-9537-00c010e7ce56+2:2397:x1871271580283008:12345-192.168.203.51@tcp:9:kworker.0 Request processed in 384us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584118.387134:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 27 00000100:00100000:2.0:1784584118.387149:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 28 00000100:00100000:2.0:1784584118.387156:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec83902b-e7e6-476f-9537-00c010e7ce56+5:2397:x1871271580283136:12345-192.168.203.51@tcp:9:kworker.0 00000020:00000080:2.0:1784584118.387168:0:18692:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48f9b 00000100:00080000:2.0:1784584118.387174:0:18692:0:(import.c:65:import_set_state_nolock()) ffff98b3049d1800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784584118.387194:0:18692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1784584118.387274:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec83902b-e7e6-476f-9537-00c010e7ce56+2:2397:x1871271580283136:12345-192.168.203.51@tcp:9:kworker.0 Request processed in 118us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584118.387280:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 28 00010000:00010000:2.0:1784584118.387296:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784584118.387337:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784584118.387341:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784584118.387361:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580282752 00000100:00100000:1.0:1784584118.387366:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580282752 00000100:00100000:1.0:1784584118.387401:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580282880 00000100:00100000:1.0:1784584118.387405:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580282880 00000100:00100000:1.0:1784584118.387428:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 69 00000100:00100000:1.0:1784584118.387435:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec83902b-e7e6-476f-9537-00c010e7ce56+6:2401:x1871271580282752:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784584118.387527:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec83902b-e7e6-476f-9537-00c010e7ce56+6:2401:x1871271580282752:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 92us (1385us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584118.387534:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 69 00000100:00100000:1.0:1784584118.387548:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 70 00000100:00100000:1.0:1784584118.387554:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec83902b-e7e6-476f-9537-00c010e7ce56+5:2400:x1871271580282880:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784584118.387579:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec83902b-e7e6-476f-9537-00c010e7ce56+5:2400:x1871271580282880:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 26us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584118.387600:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 70 00000100:00080000:2.0:1784584118.389545:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784584118.389554:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784584118.389690:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584118.447097:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784584118.447131:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30405f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599220736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784584118.447197:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584118.447266:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599220736 00000100:00100000:2.0:1784584118.447273:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599220736 00000100:00100000:2.0:1784584118.447326:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784584118.447334:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599220736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784584118.447366:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1784584118.447408:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599220736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584118.447415:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1784584118.447446:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784584118.447493:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30405f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599220736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784584118.449817:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599220864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784584118.449879:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584118.449973:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599220864 00000100:00100000:0.0:1784584118.449981:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599220864 00000100:00100000:0.0:1784584118.450035:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784584118.450045:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599220864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784584118.450071:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1784584118.450121:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599220864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584118.450128:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1784584118.450241:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784584118.450280:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599220864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784584118.450890:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3639:1871271599220992:0@lo:400:kworker.0 00000100:00100000:0.0:1784584118.450932:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584118.450961:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599221504:0@lo:400:kworker.0 00000100:00100000:0.0:1784584118.450987:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584118.451012:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599222016:0@lo:400:kworker.0 00000100:00100000:0.0:1784584118.451035:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584118.451055:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1784584118.451060:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599221120:0@lo:400:kworker.0 00000100:00100000:0.0:1784584118.451093:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584118.451110:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599221632:0@lo:400:kworker.0 00000100:00100000:0.0:1784584118.451131:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584118.451145:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1871271599222144:0@lo:400:kworker.0 00000100:00100000:0.0:1784584118.451163:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584118.451187:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599220992 00000100:00100000:0.0:1784584118.451192:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599220992 00000100:00100000:0.0:1784584118.451236:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1784584118.451256:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b417213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:3639:x1871271599220992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584118.451291:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b417213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:3639:x1871271599220992:12345-0@lo:400:kworker.0 Request processed in 38us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584118.451297:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1784584118.451319:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599221120 00000100:00100000:0.0:1784584118.451323:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599221120 00000100:00100000:0.0:1784584118.451342:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784584118.451348:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599221120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584118.451375:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599221120:12345-0@lo:400:kworker.0 Request processed in 27us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584118.451381:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784584118.451405:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599221120:0@lo:400:kworker.0 00000100:00100000:0.0:1784584118.451413:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3639:1871271599220992:0@lo:400:kworker.0 00000100:00100000:2.0:1784584118.451553:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599221376:0@lo:400:kworker.0 00000100:00100000:2.0:1784584118.451593:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584118.451609:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1871271599221888:0@lo:400:kworker.0 00000100:00100000:2.0:1784584118.451626:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584118.451639:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1784584118.451644:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599221248:0@lo:400:kworker.0 00000100:00100000:2.0:1784584118.451672:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584118.451687:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599221760:0@lo:400:kworker.0 00000100:00100000:2.0:1784584118.451707:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584118.451726:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1871271599222272:0@lo:400:kworker.0 00000100:00100000:2.0:1784584118.451746:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584118.451764:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599221504 00000100:00100000:2.0:1784584118.451767:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599221504 00000100:00100000:2.0:1784584118.451798:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599221632 00000100:00100000:2.0:1784584118.451801:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599221632 00000100:00100000:2.0:1784584118.451822:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784584118.451829:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599221504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584118.451860:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599221504:12345-0@lo:400:kworker.0 Request processed in 32us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584118.451866:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784584118.451880:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784584118.451886:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599221632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584118.451910:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599221632:12345-0@lo:400:kworker.0 Request processed in 24us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584118.451915:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784584118.451932:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599221376 00000100:00100000:2.0:1784584118.451935:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599221376 00000100:00100000:2.0:1784584118.451954:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784584118.451960:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599221376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584118.451990:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599221376:12345-0@lo:400:kworker.0 Request processed in 31us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584118.451996:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784584118.452012:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599222016 00000100:00100000:2.0:1784584118.452016:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599222016 00000100:00100000:2.0:1784584118.452035:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599222144 00000100:00100000:2.0:1784584118.452037:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599222144 00000100:00100000:2.0:1784584118.452048:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599221888 00000100:00100000:2.0:1784584118.452056:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599221888 00000100:00100000:2.0:1784584118.452070:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599221248 00000100:00100000:2.0:1784584118.452072:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599221248 00000100:00100000:2.0:1784584118.452094:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599221760 00000100:00100000:2.0:1784584118.452096:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599221760 00000100:00100000:2.0:1784584118.452105:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599222272 00000100:00100000:2.0:1784584118.452107:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599222272 00000100:00100000:2.0:1784584118.452120:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784584118.452125:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599222016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584118.452156:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599222016:12345-0@lo:400:kworker.0 Request processed in 31us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584118.452161:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784584118.452173:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784584118.452178:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1871271599222144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584118.452201:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1871271599222144:12345-0@lo:400:kworker.0 Request processed in 24us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584118.452206:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784584118.452216:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784584118.452234:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871271599221888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584118.452260:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871271599221888:12345-0@lo:400:kworker.0 Request processed in 38us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584118.452265:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784584118.452276:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784584118.452281:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599221248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584118.452304:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599221248:12345-0@lo:400:kworker.0 Request processed in 22us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584118.452310:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784584118.452329:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784584118.452334:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599221760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584118.452359:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599221760:12345-0@lo:400:kworker.0 Request processed in 25us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584118.452364:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784584118.452373:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784584118.452379:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871271599222272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584118.452402:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871271599222272:12345-0@lo:400:kworker.0 Request processed in 23us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584118.452408:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1784584118.452424:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784584118.452428:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784584118.452430:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784584118.452432:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784584118.452461:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599221248:0@lo:400:kworker.0 00000100:00100000:2.0:1784584118.452497:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599221760:0@lo:400:kworker.0 00010000:00080000:2.0:1784584118.452509:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302b44e00 x1871271599222272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584118.452518:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1871271599222272:0@lo:400:kworker.0 00000100:00100000:2.0:1784584118.452526:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599221376:0@lo:400:kworker.0 00000100:00100000:2.0:1784584118.452535:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1871271599221888:0@lo:400:kworker.0 00000100:00100000:2.0:1784584118.452570:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599221632:0@lo:400:kworker.0 00000100:00100000:2.0:1784584118.452581:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1871271599222144:0@lo:400:kworker.0 00000100:00100000:2.0:1784584118.452602:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599221504:0@lo:400:kworker.0 00010000:00080000:2.0:1784584118.452611:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302b45c00 x1871271599222016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584118.452620:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599222016:0@lo:400:kworker.0 00000100:00100000:2.0:1784584118.454985:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4376cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599222400:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784584118.455066:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584118.456389:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599222400 00000100:00100000:0.0:1784584118.456402:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599222400 00000100:00100000:0.0:1784584118.456956:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784584118.456968:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599222400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784584118.456996:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1784584118.457108:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599222400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 143us (2043us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584118.457116:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784584118.457217:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4376cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599222400:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1784584118.893846:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784584118.960961:0:17166:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:0.0:1784584118.960980:0:17166:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00000020:00080000:2.0:1784584118.961210:0:17226:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000020:00080000:2.0:1784584118.961226:0:17226:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000040:00080000:3.0:1784584119.469720:0:17220:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1784584119.469729:0:17220:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784584119.469750:0:17220:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1784584119.469758:0:17220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1784584119.918600:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584120.341800:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584120.341943:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580283392 00000100:00100000:0.0:1784584120.341952:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580283392 00000100:00100000:0.0:1784584120.342038:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 13 00000100:00100000:0.0:1784584120.342071:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+13:16363:x1871271580283392:12345-192.168.203.51@tcp:35:umount.0 00000001:00080000:0.0:1784584120.342299:0:17189:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1784584120.342370:0:17189:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:0.0:1784584120.342530:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+16:16363:x1871271580283392:12345-192.168.203.51@tcp:35:umount.0 Request processed in 468us (736us total) trans 8589934626 rc 0/0 00000100:00100000:0.0:1784584120.342537:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 13 00000020:00080000:0.0:1784584120.342542:0:17189:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00080000:2.0:1784584120.342609:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784584120.352038:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584120.352158:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584120.352757:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580283776 00000100:00100000:3.0:1784584120.352768:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580283776 00000100:00100000:3.0:1784584120.352839:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 29 00000100:00100000:3.0:1784584120.352850:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:2397:x1871271580283776:12345-192.168.203.51@tcp:9:umount.0 00000020:00000080:3.0:1784584120.352883:0:18692:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48f5c 00000100:00080000:3.0:1784584120.352905:0:18692:0:(import.c:65:import_set_state_nolock()) ffff98b302b92800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784584120.352947:0:18692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00080000:0.0:1784584120.352950:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784584120.353096:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+2:2397:x1871271580283776:12345-192.168.203.51@tcp:9:umount.0 Request processed in 248us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584120.353104:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 29 00010000:00010000:3.0:1784584120.353125:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584120.353807:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584120.360712:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580283904 00000100:00100000:2.0:1784584120.360712:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580283520 00000100:00100000:3.0:1784584120.360726:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580283904 00000100:00100000:2.0:1784584120.360726:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580283520 00000100:00100000:2.0:1784584120.360817:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 3 00000100:00100000:2.0:1784584120.360827:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+14:2400:x1871271580283520:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784584120.360841:0:17172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584120.360860:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b3041c0800/0xdab2421a42e48f32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee668 expref: 14 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584120.360876:0:17172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584120.360935:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+13:2400:x1871271580283520:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 109us (8905us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584120.360942:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 3 00000100:00100000:3.0:1784584120.361785:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 4 00000100:00100000:3.0:1784584120.361795:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+13:2398:x1871271580283904:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784584120.361806:0:17173:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584120.361818:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b303b1c600/0xdab2421a42e48ff6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee74f expref: 13 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584120.361830:0:17173:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584120.361860:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+12:2398:x1871271580283904:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 67us (8057us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584120.361867:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 4 00000100:00100000:0.0:1784584120.362873:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584120.363546:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580283648 00000100:00100000:1.0:1784584120.363558:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580283648 00000100:00100000:1.0:1784584120.363633:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 5 00000100:00100000:1.0:1784584120.363642:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43cb0d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+12:2400:x1871271580283648:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784584120.363655:0:17173:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584120.363671:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b418982800/0xdab2421a42e48f39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee699 expref: 12 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584120.363686:0:17173:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584120.363733:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43cb0d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+11:2400:x1871271580283648:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 92us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584120.363740:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 5 00000100:00100000:1.0:1784584120.369938:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584120.370001:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580284800 00000100:00100000:3.0:1784584120.370010:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580284800 00000100:00100000:3.0:1784584120.370076:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 67 00000100:00100000:3.0:1784584120.370096:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+16:2397:x1871271580284800:12345-192.168.203.51@tcp:39:umount.0 00000020:00000080:3.0:1784584120.370128:0:17187:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48f47 00000020:00010000:3.0:1784584120.370144:0:17187:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98b301f93000: total 0 00000100:00080000:3.0:1784584120.370148:0:17187:0:(import.c:65:import_set_state_nolock()) ffff98b43ed14800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784584120.370169:0:17187:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:3.0:1784584120.371613:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+15:2397:x1871271580284800:12345-192.168.203.51@tcp:39:umount.0 Request processed in 1522us (1678us total) trans 8589934627 rc 0/0 00000100:00100000:3.0:1784584120.371640:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 67 00000020:00010000:3.0:1784584120.371670:0:17175:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98b301f93000: total 0 00010000:00010000:3.0:1784584120.371714:0:17175:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98b301f93000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1784584120.371744:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98b303986600) 00010000:00010000:3.0:1784584120.371747:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584120.371754:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9a00/0xdab2421a42e4902e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee75d expref: 14 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584120.371777:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b303986100) 00010000:00010000:3.0:1784584120.371780:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784584120.371784:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8000/0xdab2421a42e4906d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee76b expref: 13 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584120.371797:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98b303986f00) 00010000:00010000:3.0:1784584120.371799:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784584120.371802:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9600/0xdab2421a42e491fc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7e9 expref: 12 pid: 18716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584120.372759:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98b303986900) 00010000:00010000:3.0:1784584120.372763:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784584120.372770:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a400/0xdab2421a42e49250 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee805 expref: 11 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584120.372785:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98b3037b7100) 00010000:00010000:3.0:1784584120.372787:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784584120.372791:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c800/0xdab2421a42e49012 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee756 expref: 10 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584120.372825:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98b403a0ea00) 00010000:00010000:3.0:1784584120.372828:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784584120.372833:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a800/0xdab2421a42e490f2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee795 expref: 9 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584120.372847:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98b303986900) 00010000:00010000:3.0:1784584120.372850:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784584120.372854:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ea7a600/0xdab2421a42e491a1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7d4 expref: 8 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584120.372867:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98b303986900) 00010000:00010000:3.0:1784584120.372870:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784584120.372874:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8c00/0xdab2421a42e49170 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee7bf expref: 7 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584120.372888:0:17175:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98b301f93000, canceled 8 locks, left on hash table 0. 00010000:00010000:3.0:1784584120.372911:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584120.372913:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584120.372915:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584120.382574:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584120.382746:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580284928 00000100:00100000:2.0:1784584120.382755:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580284928 00000100:00100000:2.0:1784584120.382834:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 68 00000100:00100000:2.0:1784584120.382861:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+5:2397:x1871271580284928:12345-192.168.203.51@tcp:39:umount.0 00000020:00000080:2.0:1784584120.382894:0:17188:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48f4e 00000100:00080000:2.0:1784584120.382912:0:17188:0:(import.c:65:import_set_state_nolock()) ffff98b30340b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784584120.382935:0:17188:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1784584120.383175:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744+3:2397:x1871271580284928:12345-192.168.203.51@tcp:39:umount.0 Request processed in 317us (620us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1784584120.383183:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 68 00010000:00010000:2.0:1784584120.383206:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784584120.383612:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1784584120.942019:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584121.006948:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599222528:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784584121.007017:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584121.007376:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599222528 00000100:00100000:1.0:1784584121.007396:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599222528 00000100:00100000:1.0:1784584121.007494:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784584121.007505:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599222528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784584121.007603:0:18696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784584121.007659:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599222528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 157us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584121.007666:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784584121.007711:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599222528:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1784584121.007922:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784584121.920520:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584121.920576:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584121.920809:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580285184 00000100:00100000:1.0:1784584121.920819:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580285184 00000100:00100000:1.0:1784584121.920882:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580285056 00000100:00100000:1.0:1784584121.920886:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580285056 00000100:00100000:1.0:1784584121.920905:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00100000:1.0:1784584121.920919:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303850e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+11:2401:x1871271580285184:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784584121.920936:0:17173:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584121.920955:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b418983800/0xdab2421a42e48f78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee709 expref: 11 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584121.920972:0:17173:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584121.921020:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303850e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+10:2401:x1871271580285184:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 106us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584121.921027:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00100000:3.0:1784584121.921028:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584121.921041:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580285312 00000100:00100000:1.0:1784584121.921044:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580285312 00000100:00100000:1.0:1784584121.921070:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:1.0:1784584121.921076:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303851880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+10:2401:x1871271580285056:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784584121.921083:0:17173:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584121.921111:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b4332b9e00/0xdab2421a42e48f71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee6d8 expref: 10 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584121.921121:0:17173:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584121.921157:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303851880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+9:2401:x1871271580285056:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 81us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584121.921164:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:1.0:1784584121.921178:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:1.0:1784584121.921185:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+8:2401:x1871271580285312:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784584121.921195:0:17173:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584121.921204:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b4332b9800/0xdab2421a42e48fef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee748 expref: 8 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584121.921214:0:17173:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584121.921231:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+7:2401:x1871271580285312:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 47us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584121.921238:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:3.0:1784584121.932463:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584121.932607:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580285568 00000100:00100000:0.0:1784584121.932617:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580285568 00000100:00100000:0.0:1784584121.932700:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 69 00000100:00100000:0.0:1784584121.932712:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec83902b-e7e6-476f-9537-00c010e7ce56+6:2397:x1871271580285568:12345-192.168.203.51@tcp:39:umount.0 00000020:00000080:0.0:1784584121.932749:0:17186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48f86 00000020:00010000:0.0:1784584121.932757:0:17186:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98b302b91800: total 0 00000100:00080000:0.0:1784584121.932761:0:17186:0:(import.c:65:import_set_state_nolock()) ffff98b302b97800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784584121.932791:0:17186:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000020:00010000:1.0:1784584121.932816:0:17175:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98b302b91800: total 0 00010000:00010000:1.0:1784584121.932821:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584121.932880:0:17175:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98b302b91800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1784584121.932924:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b303986100) 00010000:00010000:1.0:1784584121.932929:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784584121.932937:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1d800/0xdab2421a42e4907b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee772 expref: 5 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584121.932947:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec83902b-e7e6-476f-9537-00c010e7ce56+5:2397:x1871271580285568:12345-192.168.203.51@tcp:39:umount.0 Request processed in 236us (490us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1784584121.932957:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 69 00010000:00010000:1.0:1784584121.932964:0:17175:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98b302b91800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1784584121.932980:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584121.932983:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584121.932998:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784584121.933639:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584121.949747:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584121.949830:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580285696 00000100:00100000:1.0:1784584121.949840:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580285696 00000100:00100000:1.0:1784584121.949917:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 70 00000100:00100000:1.0:1784584121.949928:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec83902b-e7e6-476f-9537-00c010e7ce56+5:2397:x1871271580285696:12345-192.168.203.51@tcp:39:umount.0 00000020:00000080:1.0:1784584121.949969:0:17188:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48f8d 00000100:00080000:1.0:1784584121.949978:0:17188:0:(import.c:65:import_set_state_nolock()) ffff98b43ca68800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784584121.950005:0:17188:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00010000:00010000:2.0:1784584121.950027:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584121.950165:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec83902b-e7e6-476f-9537-00c010e7ce56+3:2397:x1871271580285696:12345-192.168.203.51@tcp:39:umount.0 Request processed in 239us (427us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1784584121.950173:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 70 00000100:00080000:3.0:1784584121.950421:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1784584121.965829:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584122.012253:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584122.012523:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580285952 00000100:00100000:1.0:1784584122.012533:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580285952 00000100:00100000:1.0:1784584122.012599:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 170 00000100:00100000:1.0:1784584122.012611:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+7:2397:x1871271580285952:12345-192.168.203.51@tcp:251:umount.0 00000020:00000080:1.0:1784584122.012666:0:17181:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48f24 00000020:00010000:1.0:1784584122.012674:0:17181:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98b301f95800: total 0 00000100:00080000:1.0:1784584122.012678:0:17181:0:(import.c:65:import_set_state_nolock()) ffff98b301f91800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1784584122.012746:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7f5b5a8-62e4-4072-a0ec-35ae69338ffe+3:2397:x1871271580285952:12345-192.168.203.51@tcp:251:umount.0 Request processed in 137us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584122.012753:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 170 00000020:00010000:3.0:1784584122.013141:0:17175:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98b301f95800: total 0 00010000:00010000:3.0:1784584122.013191:0:17175:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98b301f95800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1784584122.013225:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b3041c1600/0xdab2421a42e48f2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee661 expref: 2 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584122.013238:0:17175:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98b301f95800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1784584122.013247:0:17175:0:(genops.c:906:class_export_put()) final put ffff98b301f95800/b7f5b5a8-62e4-4072-a0ec-35ae69338ffe 00010000:00010000:3.0:1784584122.013266:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584122.013269:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584122.013270:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784584122.013314:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b301f95800/b7f5b5a8-62e4-4072-a0ec-35ae69338ffe for MGS 00000020:00000080:2.0:1784584122.013351:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b301f91800 for MGS 00000100:00100000:2.0:1784584122.030511:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599222656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784584122.030600:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584122.030780:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599222656 00000100:00100000:3.0:1784584122.030788:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599222656 00000100:00100000:3.0:1784584122.030847:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784584122.030857:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599222656:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784584122.030880:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000004:00000024:3.0:1784584122.030891:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1784584122.030891:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599222784:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784584122.030919:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584122.030975:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599222784 00000100:00100000:0.0:1784584122.030979:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599222784 00000100:00100000:0.0:1784584122.031000:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784584122.031007:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30484d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599222784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784584122.031041:0:17927:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1784584122.031069:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599222656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784584122.036719:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30484d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599222784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5700us (5786us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584122.036736:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784584122.037139:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599222784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784584122.041141:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599222656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 10275us (10531us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584122.041156:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000040:00080000:0.0:1784584122.931719:0:17939:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784584122.991859:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584123.565736:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599223296:0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.565805:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584123.565879:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599223808:0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.565901:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584123.565929:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599224320:0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.565969:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584123.565997:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1784584123.566004:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3641:1871271599222912:0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.566053:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584123.566082:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599223424:0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.566104:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584123.566124:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599223936:0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.566144:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584123.566163:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599224448:0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.566183:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584123.566209:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599223040:0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.566233:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584123.566250:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599223552:0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.566269:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584123.566289:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599224064:0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.566307:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584123.566322:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1784584123.566328:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599223168:0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.566348:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584123.566367:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599223680:0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.566386:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584123.566404:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599224192:0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.566425:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584123.566452:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599223296 00000100:00100000:3.0:1784584123.566459:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599223296 00000100:00100000:3.0:1784584123.566531:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599223808 00000100:00100000:3.0:1784584123.566534:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599223808 00000100:00100000:3.0:1784584123.566548:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599223168 00000100:00100000:3.0:1784584123.566558:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599223168 00000100:00100000:3.0:1784584123.566575:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599223680 00000100:00100000:3.0:1784584123.566577:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599223680 00000100:00100000:3.0:1784584123.566591:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784584123.566599:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599223296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.566651:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599223296:12345-0@lo:400:kworker.0 Request processed in 51us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584123.566658:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784584123.566675:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784584123.566681:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599223808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.566709:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599223808:12345-0@lo:400:kworker.0 Request processed in 29us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584123.566715:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784584123.566725:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784584123.566730:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c237100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599223168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.566760:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c237100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599223168:12345-0@lo:400:kworker.0 Request processed in 31us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584123.566766:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784584123.566777:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784584123.566782:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c236680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599223680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.566809:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c236680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599223680:12345-0@lo:400:kworker.0 Request processed in 27us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584123.566815:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784584123.566832:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599222912 00000100:00100000:3.0:1784584123.566835:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599222912 00000100:00100000:3.0:1784584123.566896:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1784584123.566902:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41720c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:3641:x1871271599222912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.566941:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41720c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:3641:x1871271599222912:12345-0@lo:400:kworker.0 Request processed in 38us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584123.566947:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1784584123.566973:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599224320 00000100:00100000:3.0:1784584123.566976:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599224320 00000100:00100000:3.0:1784584123.566994:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599223424 00000100:00100000:3.0:1784584123.566997:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599223424 00000100:00100000:3.0:1784584123.567006:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599223936 00000100:00100000:3.0:1784584123.567008:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599223936 00000100:00100000:3.0:1784584123.567015:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599224448 00000100:00100000:3.0:1784584123.567017:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599224448 00000100:00100000:3.0:1784584123.567026:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599224064 00000100:00100000:3.0:1784584123.567028:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599224064 00000100:00100000:3.0:1784584123.567037:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599224192 00000100:00100000:3.0:1784584123.567038:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599224192 00000100:00100000:3.0:1784584123.567062:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784584123.567068:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599224320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.567097:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599224320:12345-0@lo:400:kworker.0 Request processed in 29us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584123.567102:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784584123.567112:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784584123.567116:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599223424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.567146:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599223424:12345-0@lo:400:kworker.0 Request processed in 25us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584123.567152:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784584123.567162:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784584123.567167:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599223936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.567193:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599223936:12345-0@lo:400:kworker.0 Request processed in 26us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584123.567206:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784584123.567218:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784584123.567223:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599224448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.567266:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599224448:12345-0@lo:400:kworker.0 Request processed in 42us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584123.567272:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784584123.567283:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784584123.567288:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871271599224064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.567314:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871271599224064:12345-0@lo:400:kworker.0 Request processed in 26us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584123.567318:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784584123.567327:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784584123.567332:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599224192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.567354:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599224192:12345-0@lo:400:kworker.0 Request processed in 23us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584123.567359:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784584123.567377:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599223040 00000100:00100000:3.0:1784584123.567380:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599223040 00000100:00100000:3.0:1784584123.567400:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599223552 00000100:00100000:3.0:1784584123.567404:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599223552 00000100:00100000:3.0:1784584123.567415:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784584123.567421:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599223040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.567453:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599223040:12345-0@lo:400:kworker.0 Request processed in 31us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584123.567458:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784584123.567498:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784584123.567503:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599223552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.567533:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599223552:12345-0@lo:400:kworker.0 Request processed in 30us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584123.567539:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1784584123.567559:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784584123.567562:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784584123.567565:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784584123.567567:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784584123.567612:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599223168:0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.567622:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599223680:0@lo:400:kworker.0 00010000:00080000:3.0:1784584123.567634:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302b45c00 x1871271599224192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584123.567644:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599224192:0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.567654:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599223040:0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.567661:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599223552:0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.567668:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599224064:0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.567701:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3641:1871271599222912:0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.567710:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599223424:0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.567718:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599223936:0@lo:400:kworker.0 00010000:00080000:3.0:1784584123.567726:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302b44a80 x1871271599224448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584123.567745:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599224448:0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.567757:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599223296:0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.567766:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599223808:0@lo:400:kworker.0 00000100:00100000:3.0:1784584123.567775:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599224320:0@lo:400:kworker.0 00000100:00100000:2.0:1784584123.568279:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599224704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784584123.568317:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584123.568346:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784584123.568351:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599224576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784584123.568372:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584123.568399:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599224704 00000100:00100000:2.0:1784584123.568403:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599224576 00000100:00100000:2.0:1784584123.568405:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599224576 00000100:00100000:1.0:1784584123.568405:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599224704 00000100:00100000:2.0:1784584123.568431:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784584123.568443:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599224704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784584123.568465:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1784584123.568518:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599224704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584123.570616:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599224832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784584123.570669:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584123.570710:0:18696:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1784584123.570725:0:18696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1784584123.570815:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599224832 00000100:00100000:1.0:1784584123.570822:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599224832 00000100:00100000:1.0:1784584123.570909:0:20736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784584123.570934:0:20736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599224576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784584123.570955:0:20736:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1784584123.570990:0:20736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599224576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (2617us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584123.570997:0:20736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784584123.571012:0:20736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784584123.571018:0:20736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599224832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784584123.571032:0:20736:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784584123.571072:0:20736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599224832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584123.571078:0:20736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784584123.571111:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599224832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784584123.572284:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784584123.572358:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599224576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784584123.572375:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599224704:0@lo:13:osp-pre-1-1.0 00000001:00100000:1.0:1784584123.572496:0:18688:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec83902b-e7e6-476f-9537-00c010e7ce56 00000020:00000080:1.0:1784584123.572501:0:18688:0:(genops.c:906:class_export_put()) final put ffff98b43eb07000/ec83902b-e7e6-476f-9537-00c010e7ce56 00000001:00100000:1.0:1784584123.572516:0:18688:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744 00000020:00000080:1.0:1784584123.572518:0:18688:0:(genops.c:906:class_export_put()) final put ffff98b302b96000/c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744 00000020:00000080:2.0:1784584123.573022:0:473:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43eb07000/ec83902b-e7e6-476f-9537-00c010e7ce56 for lustre-OST0000 00000020:00000080:2.0:1784584123.573081:0:473:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302b96000/c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744 for lustre-OST0000 00000020:00000080:2.0:1784584123.573096:0:473:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b43c23b800 for lustre-OST0000 00000020:00000080:2.0:1784584123.573100:0:473:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b302b96800 for lustre-OST0000 00000001:00100000:2.0:1784584123.574010:0:19508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744 00000020:00000080:2.0:1784584123.574017:0:19508:0:(genops.c:906:class_export_put()) final put ffff98b302b92000/c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744 00000001:00100000:2.0:1784584123.574409:0:19508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ec83902b-e7e6-476f-9537-00c010e7ce56 00000020:00000080:2.0:1784584123.574413:0:19508:0:(genops.c:906:class_export_put()) final put ffff98b3049d1000/ec83902b-e7e6-476f-9537-00c010e7ce56 00000020:00000080:1.0:1784584123.575425:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302b92000/c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744 for lustre-OST0001 00000020:00000080:1.0:1784584123.575490:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b302b92800 for lustre-OST0001 00000020:00000080:3.0:1784584123.577384:0:473:0:(genops.c:865:class_export_destroy()) destroying export ffff98b3049d1000/ec83902b-e7e6-476f-9537-00c010e7ce56 for lustre-OST0001 00000020:00000080:3.0:1784584123.577427:0:473:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b3049d1800 for lustre-OST0001 00000020:01000004:0.0:1784584123.812788:0:20757:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1784584123.824654:0:20757:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1784584123.824778:0:20757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4172ce800/0xdab2421a42e48ae7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48aee expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584123.824793:0:20757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4172ce800/0xdab2421a42e48ae7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48aee expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584123.824801:0:20757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4172ce800/0xdab2421a42e48ae7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e48aee expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584123.824807:0:20757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b4172ce800/0xdab2421a42e48ae7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e48aee expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584123.824835:0:20757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1784584123.824841:0:20757:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1784584123.824864:0:20757:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784584123.824868:0:20757:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1784584123.824873:0:20757:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1784584123.824896:0:20757:0:(import.c:65:import_set_state_nolock()) ffff98b416bda800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1784584123.825018:0:19525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584123.825026:0:19525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b4172ce800/0xdab2421a42e48ae7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e48aee expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584123.825033:0:19525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172ce800 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:1.0:1784584123.825057:0:19525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b4172ce800/0xdab2421a42e48ae7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e48aee expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584123.825065:0:19525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b4172ce800/0xdab2421a42e48ae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e48aee expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784584123.825072:0:19525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b4172ce800/0xdab2421a42e48ae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e48aee expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584123.825077:0:19525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784584123.825079:0:19525:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1784584123.825082:0:19525:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1784584123.825107:0:19525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b4172ce800/0xdab2421a42e48ae7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e48aee expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584123.825114:0:19525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1784584123.825305:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1871271599224960:0@lo:39:umount.0 00000100:00100000:2.0:1784584123.825370:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584123.825419:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599224960 00000100:00100000:2.0:1784584123.825425:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599224960 00010000:00010000:1.0:1784584123.825463:0:19525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b4172ce800/0xdab2421a42e48ae7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e48aee expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584123.825485:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00010000:00010000:1.0:1784584123.825487:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b4172ce800/0xdab2421a42e48ae7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e48aee expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584123.825494:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4376cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1871271599224960:12345-0@lo:39:umount.0 00010000:00010000:1.0:1784584123.825497:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584123.825499:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584123.825500:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584123.825507:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784584123.825517:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3641:1871271599225088:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1784584123.825596:0:17186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48b18 00000100:00080000:2.0:1784584123.825605:0:17186:0:(import.c:65:import_set_state_nolock()) ffff98b43ca6b000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1784584123.825661:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584123.825675:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4376cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3638:x1871271599224960:12345-0@lo:39:umount.0 Request processed in 182us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584123.825682:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:2.0:1784584123.825690:0:17186:0:(genops.c:906:class_export_put()) final put ffff98b418032000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1784584123.825713:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784584123.825721:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b418032000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1784584123.825759:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b43ca6b000 for lustre-MDT0000 00000100:00080000:0.0:1784584123.825761:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b416bda800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1784584123.825769:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1871271599224960:0@lo:39:umount.0 00000100:00080000:0.0:1784584123.825789:0:20757:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784584123.825798:0:20757:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1784584123.825801:0:20757:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1784584123.826033:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599225088 00000100:00100000:1.0:1784584123.826037:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599225088 00000100:00100000:1.0:1784584123.826088:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784584123.826102:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:3641:x1871271599225088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784584123.826113:0:17173:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584123.826127:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b3041c0000/0xdab2421a42e48aee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e48ae7 expref: 24 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584123.826141:0:17173:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584123.826182:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+23:3641:x1871271599225088:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584123.826200:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784584123.826227:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3641:1871271599225088:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784584123.827998:0:20757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e48a38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48a3f expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584123.828013:0:20757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e48a38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48a3f expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584123.828019:0:20757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e48a38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e48a3f expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584123.828023:0:20757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e48a38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e48a3f expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584123.828046:0:20757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784584123.828053:0:20757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48d80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48d87 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584123.828060:0:20757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48d80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48d87 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584123.828066:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784584123.828066:0:20757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48d80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e48d87 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584123.828071:0:20757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48d80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e48d87 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584123.828073:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e48a38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e48a3f expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584123.828081:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96200 already unused, calling callback (ffffffffc1439c20) 00010000:00010000:0.0:1784584123.828129:0:20757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784584123.828139:0:20757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e48fe1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48fe8 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584123.828160:0:20757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e48fe1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48fe8 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584123.828166:0:20757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e48fe1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e48fe8 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584123.828172:0:20757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e48fe1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e48fe8 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584123.828250:0:19525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784584123.828256:0:19525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48d80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e48d87 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584123.828262:0:19525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8a00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:1.0:1784584123.828265:0:19525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48d80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e48d87 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584123.828274:0:19525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48d80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e48d87 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784584123.828281:0:19525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48d80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e48d87 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584123.828287:0:19525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1784584123.828290:0:19525:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1784584123.828293:0:19525:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1784584123.828324:0:19525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48d80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e48d87 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584123.828342:0:19525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784584123.828372:0:19525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48d80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e48d87 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584123.828380:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8a00/0xdab2421a42e48d80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e48d87 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784584123.828384:0:17174:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e48a38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e48a3f expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584123.828393:0:17174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e48a38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e48a3f expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784584123.828399:0:17174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e48a38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e48a3f expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584123.828399:0:19525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584123.828403:0:19525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e48fe1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e48fe8 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584123.828405:0:17174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784584123.828407:0:17174:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1784584123.828409:0:19525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1d600 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:1.0:1784584123.828412:0:19525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e48fe1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e48fe8 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584123.828418:0:19525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e48fe1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e48fe8 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584123.828422:0:17174:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e48a38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e48a3f expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784584123.828424:0:19525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e48fe1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e48fe8 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584123.828428:0:17174:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:1.0:1784584123.828430:0:19525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1784584123.828432:0:19525:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1784584123.828440:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e48a38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e48a3f expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584123.828441:0:19525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e48fe1 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e48fe8 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584123.828447:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b403b96200/0xdab2421a42e48a38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e48a3f expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584123.828447:0:19525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784584123.828456:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584123.828458:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584123.828460:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584123.828462:0:19525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e48fe1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e48fe8 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584123.828598:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784584123.828616:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3642:1871271599225472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584123.828675:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784584123.828777:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584123.828779:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584123.828780:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584123.828863:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599225472 00000100:00100000:3.0:1784584123.828875:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599225472 00000100:00100000:2.0:1784584123.828908:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3639:1871271599225216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784584123.828948:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584123.828971:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784584123.828977:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c235880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3639:1871271599225344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784584123.829000:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584123.829012:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599225216 00000100:00100000:3.0:1784584123.829016:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599225216 00000100:00100000:2.0:1784584123.829021:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599225344 00000100:00100000:2.0:1784584123.829024:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599225344 00000100:00100000:3.0:1784584123.829034:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784584123.829053:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c235500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+25:3642:x1871271599225472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784584123.829066:0:17171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584123.829079:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b4332b8a00/0xdab2421a42e48fe8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e48fe1 expref: 25 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584123.829175:0:20757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784584123.829181:0:20757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e48fe1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e48fe8 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584123.829200:0:20757:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1784584123.829208:0:20757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e48a2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48a31 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584123.829214:0:20757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e48a2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48a31 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584123.829220:0:20757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e48a2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e48a31 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584123.829225:0:20757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e48a2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e48a31 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584123.829238:0:20757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1784584123.829240:0:20757:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1784584123.829243:0:20757:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1784584123.829283:0:20757:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1784584123.829287:0:20757:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1784584123.829292:0:20757:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784584123.829297:0:20757:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1784584123.829302:0:20757:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98b3048f3800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784584123.829307:0:20757:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98b430f6f800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784584123.829311:0:20757:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98b302bd2000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784584123.829315:0:20757:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98b302bd0800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784584123.829321:0:20757:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff98b302b91800 ec83902b-e7e6-476f-9537-00c010e7ce56 192.168.203.51@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:0.0:1784584123.829326:0:20757:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff98b301f93000 c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744 192.168.203.51@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:0.0:1784584123.829331:0:20757:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff98b30247b380) has exports, disconnecting them 00000020:00080000:0.0:1784584123.829334:0:20757:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98b3048f3800), last request at 1784584123 00000020:00000080:0.0:1784584123.829341:0:20757:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48d4f 00000100:00080000:0.0:1784584123.829357:0:20757:0:(import.c:65:import_set_state_nolock()) ffff98b3048f5800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1784584123.829412:0:20757:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98b3048f3800): rc 0 00000020:00000080:0.0:1784584123.829415:0:20757:0:(genops.c:906:class_export_put()) final put ffff98b3048f3800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1784584123.829424:0:20757:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98b430f6f800), last request at 1784584123 00000020:00000080:0.0:1784584123.829429:0:20757:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48cb5 00000100:00080000:0.0:1784584123.829434:0:20757:0:(import.c:65:import_set_state_nolock()) ffff98b430f6e000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1784584123.829440:0:20757:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98b430f6f800): rc 0 00000020:00000080:0.0:1784584123.829442:0:20757:0:(genops.c:906:class_export_put()) final put ffff98b430f6f800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1784584123.829445:0:20757:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98b302bd2000), last request at 1784584060 00000020:00000080:0.0:1784584123.829448:0:20757:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48c06 00000100:00080000:0.0:1784584123.829451:0:20757:0:(import.c:65:import_set_state_nolock()) ffff98b404995000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1784584123.829456:0:20757:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98b302bd2000): rc 0 00000020:00000080:0.0:1784584123.829458:0:20757:0:(genops.c:906:class_export_put()) final put ffff98b302bd2000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1784584123.829490:0:20757:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98b302bd0800), last request at 1784584060 00000020:00000080:0.0:1784584123.829493:0:20757:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48ba4 00000100:00080000:0.0:1784584123.829497:0:20757:0:(import.c:65:import_set_state_nolock()) ffff98b43ed16800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784584123.829504:0:20757:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00010000:00010000:1.0:1784584123.829650:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584123.829656:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e48a2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e48a31 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584123.829664:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96c00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:1.0:1784584123.829677:0:17175:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e48a2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e48a31 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584123.829686:0:17175:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e48a2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e48a31 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784584123.829693:0:17175:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e48a2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e48a31 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584123.829698:0:17175:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1784584123.829700:0:17175:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1784584123.829703:0:17175:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1784584123.829724:0:17175:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e48a2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e48a31 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584123.829729:0:17175:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784584123.829743:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e48a2a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e48a31 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584123.829749:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b403b96c00/0xdab2421a42e48a2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e48a31 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584123.829770:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584123.829772:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584123.829773:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584123.829779:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784584123.829790:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3641:1871271599225600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784584123.829825:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584123.829853:0:17173:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1784584123.829861:0:17173:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1784584123.829895:0:17171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784584123.829954:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584123.830025:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c235500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:3642:x1871271599225472:12345-0@lo:103:ldlm_bl.0 Request processed in 972us (1348us total) trans 0 rc 0/0 00000020:00080000:0.0:1784584123.830091:0:20757:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98b302bd0800): rc 0 00000004:00000080:0.0:1784584123.830098:0:20757:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbb9d48083ae0 00000100:00080000:0.0:1784584123.830114:0:20757:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784584123.830117:0:20757:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00100000:2.0:1784584123.831006:0:17172:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1784584123.831020:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599225600 00000100:00100000:2.0:1784584123.831027:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599225600 00000100:00100000:3.0:1784584123.831079:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784584123.831133:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784584123.831153:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303851180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+24:3639:x1871271599225216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784584123.831167:0:17172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584123.831184:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b403b96a00/0xdab2421a42e48d87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e48d80 expref: 24 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584123.831206:0:17172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584123.831264:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303851180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+23:3639:x1871271599225216:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (2314us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584123.831271:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784584123.831284:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784584123.831301:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43cb0d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+22:3639:x1871271599225344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784584123.831310:0:17172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584123.831319:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b4172cf000/0xdab2421a42e48a3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e48a38 expref: 22 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584123.831328:0:17172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584123.831349:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43cb0d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+21:3639:x1871271599225344:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (2348us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584123.831355:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784584123.831392:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784584123.831398:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+20:3641:x1871271599225600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784584123.831404:0:17172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584123.831413:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b43ebd9600/0xdab2421a42e48a31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e48a2a expref: 20 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584123.831421:0:17172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584123.831445:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f92bc391-87f9-4f08-829f-ff6dbf39f6d6+19:3641:x1871271599225600:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (1620us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584123.831451:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000020:00000080:2.0:1784584123.831485:0:473:0:(genops.c:865:class_export_destroy()) destroying export ffff98b3048f3800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:1.0:1784584123.831496:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c235880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3639:1871271599225344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784584123.831505:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3639:1871271599225216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784584123.831534:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3641:1871271599225600:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1784584123.831537:0:473:0:(genops.c:865:class_export_destroy()) destroying export ffff98b430f6f800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1784584123.831555:0:473:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302bd2000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1784584123.831576:0:473:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b3048f5800 for lustre-MDT0000 00000020:00000080:2.0:1784584123.831580:0:473:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b430f6e000 for lustre-MDT0000 00000020:00000080:2.0:1784584123.831586:0:473:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b404995000 for lustre-MDT0000 00000100:00100000:3.0:1784584123.831980:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3642:1871271599225472:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784584123.831999:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784584123.832072:0:20757:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1784584123.832094:0:20757:0:(import.c:65:import_set_state_nolock()) ffff98b43cb02000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1784584123.832167:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599225728:0@lo:39:umount.0 00000100:00100000:2.0:1784584123.832271:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584123.832351:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599225728 00000100:00100000:0.0:1784584123.832358:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599225728 00000100:00100000:0.0:1784584123.832641:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784584123.832655:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1871271599225728:12345-0@lo:39:umount.0 00000100:00080000:2.0:1784584123.832723:0:20757:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784584123.832727:0:20757:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000020:00000080:0.0:1784584123.832752:0:17927:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48c30 00000100:00080000:0.0:1784584123.832759:0:17927:0:(import.c:65:import_set_state_nolock()) ffff98b406166000 : changing import state from FULL to CLOSED 00000004:00080000:2.0:1784584123.832770:0:20757:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000001:00000004:0.0:1784584123.832784:0:17927:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00080000:2.0:1784584123.832826:0:20757:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1784584123.832837:0:20757:0:(import.c:65:import_set_state_nolock()) ffff98b43cb07800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1784584123.832848:0:20757:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784584123.832851:0:20757:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:2.0:1784584123.832859:0:20757:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784584123.832895:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3638:x1871271599225728:12345-0@lo:39:umount.0 Request processed in 246us (624us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1784584123.832903:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784584123.832926:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599225856:0@lo:9:umount.0 00000100:00100000:2.0:1784584123.832963:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784584123.833002:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43cb02000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1784584123.833008:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599225728:0@lo:39:umount.0 00010000:00010000:1.0:1784584123.833023:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784584123.833026:0:20757:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1784584123.833064:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599225856 00000100:00080000:2.0:1784584123.833065:0:20757:0:(import.c:65:import_set_state_nolock()) ffff98b43e8cb800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1784584123.833068:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599225856 00000100:00100000:2.0:1784584123.833081:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599225984:0@lo:9:umount.0 00000100:00100000:2.0:1784584123.833105:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584123.833280:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599225984 00000100:00100000:0.0:1784584123.833284:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599225984 00000100:00100000:3.0:1784584123.833299:0:19378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784584123.833376:0:19378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1871271599225856:12345-0@lo:9:umount.0 00000100:00100000:0.0:1784584123.833383:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000020:00000080:3.0:1784584123.833392:0:19378:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48daa 00000100:00080000:3.0:1784584123.833397:0:19378:0:(import.c:65:import_set_state_nolock()) ffff98b302462800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1784584123.833399:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437691500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1871271599225984:12345-0@lo:9:umount.0 00000020:00000080:0.0:1784584123.833412:0:18693:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48d8e 00000100:00080000:0.0:1784584123.833416:0:18693:0:(import.c:65:import_set_state_nolock()) ffff98b301f97000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784584123.833430:0:19378:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000001:00000004:0.0:1784584123.833448:0:18693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000020:00080000:2.0:1784584123.833801:0:20757:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff98b30247b380) has no exports 00000100:00100000:3.0:1784584123.834026:0:19378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3638:x1871271599225856:12345-0@lo:9:umount.0 Request processed in 664us (1062us total) trans 0 rc 0/0 00000100:00080000:1.0:1784584123.834031:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43cb07800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1784584123.834033:0:19378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000004:00080000:1.0:1784584123.834053:0:3638:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1784584123.834055:0:3638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784584123.834058:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599225856:0@lo:9:umount.0 00000100:00100000:0.0:1784584123.834156:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437691500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3638:x1871271599225984:12345-0@lo:9:umount.0 Request processed in 767us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584123.834163:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1784584123.834196:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784584123.834284:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43e8cb800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1784584123.834294:0:3638:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1784584123.834296:0:3638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784584123.834299:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599225984:0@lo:9:umount.0 00010000:00010000:3.0:1784584123.834383:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1784584123.847491:0:20757:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff98b30247b380) has no exports 00000020:00000080:3.0:1784584123.911834:0:20757:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48a85 00000020:00000080:3.0:1784584123.911854:0:20757:0:(genops.c:906:class_export_put()) final put ffff98b43cb00800/lustre-QMT0000_UUID 00000020:01000000:3.0:1784584123.911881:0:20757:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1784584123.911954:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43cb00800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1784584123.911992:0:20757:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784584123.912003:0:20757:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1784584123.912008:0:20757:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff98b302a4b380) has no exports 00000020:00000080:2.0:1784584123.912489:0:20757:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48a7e 00000020:00000080:2.0:1784584123.912497:0:20757:0:(genops.c:906:class_export_put()) final put ffff98b43e8cf800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784584123.912574:0:20757:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784584123.912583:0:20757:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1784584123.912585:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43e8cf800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784584123.912587:0:20757:0:(genops.c:906:class_export_put()) final put ffff98b43e8c9800/lustre-QMT0000_UUID 00000020:00000080:2.0:1784584123.912592:0:20757:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43e8c9800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1784584123.912600:0:20757:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:1.0:1784584124.013622:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584125.037623:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784584125.618062:0:17919:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1784584125.618079:0:17919:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:0.0:1784584125.618084:0:17919:0:(genops.c:906:class_export_put()) final put ffff98b418105800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1784584125.618233:0:17919:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ec83902b-e7e6-476f-9537-00c010e7ce56 00000001:00080000:0.0:1784584125.618240:0:17919:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:0.0:1784584125.618243:0:17919:0:(genops.c:906:class_export_put()) final put ffff98b43ca6b800/ec83902b-e7e6-476f-9537-00c010e7ce56 00000001:00100000:0.0:1784584125.618249:0:17919:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744 00000001:00080000:0.0:1784584125.618256:0:17919:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1784584125.618258:0:17919:0:(genops.c:906:class_export_put()) final put ffff98b30340e000/c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744 00000020:00000080:2.0:1784584125.618312:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b418105800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1784584125.618372:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43ca6b800/ec83902b-e7e6-476f-9537-00c010e7ce56 for lustre-MDT0001 00000020:00000080:2.0:1784584125.618397:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b30340e000/c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744 for lustre-MDT0001 00000020:00000080:2.0:1784584125.618416:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b406166000 for lustre-MDT0001 00000020:00000080:2.0:1784584125.618420:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b43ca68800 for lustre-MDT0001 00000020:00000080:2.0:1784584125.618423:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b30340b800 for lustre-MDT0001 00000001:00100000:2.0:1784584125.618961:0:17166:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1784584125.618966:0:17166:0:(genops.c:906:class_export_put()) final put ffff98b302bd0800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1784584125.618985:0:17166:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ec83902b-e7e6-476f-9537-00c010e7ce56 00000001:00080000:2.0:1784584125.618991:0:17166:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:2.0:1784584125.618993:0:17166:0:(genops.c:906:class_export_put()) final put ffff98b302b91800/ec83902b-e7e6-476f-9537-00c010e7ce56 00000001:00100000:2.0:1784584125.618998:0:17166:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744 00000001:00080000:2.0:1784584125.619003:0:17166:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:2.0:1784584125.619009:0:17166:0:(genops.c:906:class_export_put()) final put ffff98b301f93000/c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744 00000020:00000080:0.0:1784584125.619127:0:473:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302bd0800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1784584125.619181:0:473:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302b91800/ec83902b-e7e6-476f-9537-00c010e7ce56 for lustre-MDT0000 00000020:00000080:0.0:1784584125.619203:0:473:0:(genops.c:865:class_export_destroy()) destroying export ffff98b301f93000/c7ba886f-d9f6-4098-bcfe-6c4c5ebe5744 for lustre-MDT0000 00000020:00000080:0.0:1784584125.619223:0:473:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b43ed16800 for lustre-MDT0000 00000020:00000080:0.0:1784584125.619227:0:473:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b302b97800 for lustre-MDT0000 00000020:00000080:0.0:1784584125.619230:0:473:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b43ed14800 for lustre-MDT0000 00000020:01000000:2.0:1784584125.936226:0:20757:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98b40678c5a0 - data ffff98b41dc0f0d8/ffff98b405d46800 00000020:01000000:2.0:1784584125.936370:0:20757:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98b43e65e000 - data ffff98b41dc8a798/ffff98b43fd98c00 00000001:00000004:2.0:1784584125.944807:0:20757:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:2.0:1784584125.993820:0:20757:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784584125.993828:0:20757:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784584125.993844:0:20757:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff98b43c8eed80 x1871271599225728/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784584133 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584125.993869:0:20757:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1784584125.997457:0:20757:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784584125.997464:0:20757:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1784584125.999003:0:20757:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784584125.999007:0:20757:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1784584126.001902:0:17210:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1784584126.001908:0:17210:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1784584126.001918:0:17210:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1784584126.002876:0:20757:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784584126.002882:0:20757:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:2.0:1784584126.002989:0:20757:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784584126.002998:0:20757:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1784584126.003343:0:17212:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1784584126.003347:0:17212:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:0.0:1784584126.003354:0:17212:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1784584126.009459:0:20757:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48a4d 00000020:00000080:2.0:1784584126.009826:0:20757:0:(genops.c:906:class_export_put()) final put ffff98b41e60b000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784584126.013597:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b41e60b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784584126.014869:0:20757:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48a62 00000020:00000080:1.0:1784584126.014890:0:20757:0:(genops.c:906:class_export_put()) final put ffff98b41e60b800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784584126.016911:0:20757:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1784584126.016923:0:20757:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784584126.016933:0:20757:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784584126.016937:0:20757:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff98b302478000) has no exports 00000004:01000000:1.0:1784584126.017247:0:20757:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1784584126.017256:0:20757:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48ac4 00000020:00000080:1.0:1784584126.017264:0:20757:0:(genops.c:906:class_export_put()) final put ffff98b302b08000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784584126.017269:0:20757:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1784584126.017273:0:20757:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784584126.017278:0:20757:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1784584126.017280:0:20757:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff98b42e933380) has no exports 00000020:00000080:1.0:1784584126.017287:0:20757:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48abd 00000020:00000080:1.0:1784584126.017290:0:20757:0:(genops.c:906:class_export_put()) final put ffff98b302b0a000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1784584126.017651:0:20757:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1784584126.017940:0:20757:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784584126.017944:0:20757:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:1.0:1784584126.017950:0:20757:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784584126.017952:0:20757:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784584126.018210:0:20757:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784584126.018217:0:20757:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784584126.018223:0:20757:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48aaf 00000020:00000080:1.0:1784584126.018228:0:20757:0:(genops.c:906:class_export_put()) final put ffff98b302b0d000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784584126.018232:0:20757:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1784584126.018314:0:20757:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784584126.018319:0:20757:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1784584126.018323:0:20757:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff98b302a4cd40) has no exports 00000020:00000080:1.0:1784584126.018328:0:20757:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48aa8 00000020:00000080:1.0:1784584126.018332:0:20757:0:(genops.c:906:class_export_put()) final put ffff98b43cb02800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1784584126.018810:0:20757:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1784584126.018814:0:20757:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784584126.018817:0:20757:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1784584126.018831:0:20757:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784584126.018832:0:20757:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784584126.021908:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b41e60b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1784584126.021926:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302b08000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1784584126.021950:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302b0a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784584126.021957:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b43e8cb800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1784584126.021967:0:36:0:(genops.c:906:class_export_put()) final put ffff98b302b0b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784584126.022272:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302b0b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1784584126.022281:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784584126.022361:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302b0d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1784584126.022366:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43cb02800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784584126.022600:0:20757:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784584126.022613:0:20757:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1784584126.022707:0:20757:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1784584126.022716:0:20757:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48a9a 00000020:00000080:1.0:1784584126.022723:0:20757:0:(genops.c:906:class_export_put()) final put ffff98b43e8cd800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784584126.022728:0:20757:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1784584126.022733:0:20757:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784584126.022738:0:20757:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1784584126.022742:0:20757:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff98b4071a8000) has no exports 00000020:00000080:1.0:1784584126.022748:0:20757:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48a93 00000020:00000080:1.0:1784584126.022751:0:20757:0:(genops.c:906:class_export_put()) final put ffff98b43cb05000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784584126.022937:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b43cb07800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1784584126.022943:0:36:0:(genops.c:906:class_export_put()) final put ffff98b43e8cc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784584126.022945:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43e8cc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1784584126.022950:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784584126.022999:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43e8cd800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1784584126.023005:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43cb05000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1784584126.026527:0:20757:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1784584126.026535:0:20757:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784584126.026539:0:20757:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784584126.026546:0:20757:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784584126.026598:0:20757:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784584126.026608:0:20757:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784584126.026651:0:20757:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784584126.026655:0:20757:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784584126.026661:0:20757:0:(genops.c:906:class_export_put()) final put ffff98b41e609000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784584126.026665:0:20757:0:(genops.c:865:class_export_destroy()) destroying export ffff98b41e609000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1784584126.026677:0:20757:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784584126.026770:0:20757:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48a69 00000020:00000080:0.0:1784584126.026787:0:20757:0:(genops.c:906:class_export_put()) final put ffff98b41e60d800/lustre-MDD0000_UUID 00000020:01000000:0.0:1784584126.026799:0:20757:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1784584126.026803:0:20757:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784584126.026816:0:20757:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784584126.026820:0:20757:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff98b3024799c0) has no exports 00000020:00000080:2.0:1784584126.026829:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b43cb02000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1784584126.026836:0:36:0:(genops.c:906:class_export_put()) final put ffff98b43cb05800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784584126.026838:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43cb05800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1784584126.026840:0:20757:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:01000000:2.0:1784584126.026843:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784584126.026843:0:20757:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1784584126.026847:0:20757:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48a70 00000020:00000080:0.0:1784584126.026851:0:20757:0:(genops.c:906:class_export_put()) final put ffff98b41e60f800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1784584126.026865:0:20757:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98b3041fd000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1784584126.026869:0:20757:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b3041fd000 3 00000020:01000004:0.0:1784584126.026872:0:20757:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98b3041fd000 from lustre-MDT0000 00000020:00000080:0.0:1784584126.026888:0:20757:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784584126.026891:0:20757:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1784584126.026893:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b41e60d800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1784584126.026893:0:20757:0:(genops.c:906:class_export_put()) final put ffff98b41e60e800/lustre-MDT0000_UUID 00000020:00000080:0.0:1784584126.026895:0:20757:0:(genops.c:865:class_export_destroy()) destroying export ffff98b41e60e800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1784584126.026896:0:36:0:(genops.c:906:class_export_put()) final put ffff98b41e60a000/lustre-MDD0000_UUID 00000020:00000080:2.0:1784584126.026898:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b41e60a000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1784584126.026901:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000000:0.0:1784584126.026901:0:20757:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:2.0:1784584126.026924:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b41e60f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1784584126.026936:0:20757:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1784584126.026940:0:20757:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1784584126.026943:0:20757:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1784584126.026946:0:20757:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784584126.026949:0:20757:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784584126.026954:0:20757:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff98b43e815800 f92bc391-87f9-4f08-829f-ff6dbf39f6d6 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784584126.026960:0:20757:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff98b30247cd40) has exports, disconnecting them 00000020:00080000:0.0:1784584126.026964:0:20757:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff98b43e815800), last request at 1784584047 00000020:00000080:0.0:1784584126.026985:0:20757:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48a15 00000020:00010000:0.0:1784584126.026989:0:20757:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98b43e815800: total 0 00000100:00080000:0.0:1784584126.026992:0:20757:0:(import.c:65:import_set_state_nolock()) ffff98b418942800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1784584126.027007:0:20757:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98b43e815800): rc 0 00000020:00080000:0.0:1784584126.027011:0:20757:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff98b30247cd40) has no exports 00000100:00100000:0.0:1784584126.027070:0:17179:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff98b303a84800:17179] 0 exiting: rc = 1 00000020:00010000:2.0:1784584126.027107:0:19525:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98b43e815800: total 0 00010000:00010000:2.0:1784584126.027131:0:19525:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98b43e815800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1784584126.027156:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b3041c1000/0xdab2421a42e48c76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e48c6f expref: 14 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584126.027174:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b43ebd8600/0xdab2421a42e48d10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e48d09 expref: 13 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584126.027185:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b4332b8600/0xdab2421a42e48fbe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e48fb7 expref: 12 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584126.027194:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b4172cee00/0xdab2421a42e48b34 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e48b2d expref: 11 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584126.027206:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b4172ce600/0xdab2421a42e48b42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e48b3b expref: 10 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584126.027216:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b3041c1a00/0xdab2421a42e48fda lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e48fd3 expref: 9 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584126.027287:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b4172cf400/0xdab2421a42e48b50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e48b49 expref: 8 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584126.027302:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b3041c0600/0xdab2421a42e48a23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e48a1c expref: 7 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584126.027312:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b3041c0200/0xdab2421a42e48ca0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e48c99 expref: 6 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584126.027322:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b4332b9c00/0xdab2421a42e48fcc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e48fc5 expref: 5 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584126.027331:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b4172cfa00/0xdab2421a42e48bf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e48bea expref: 4 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584126.027340:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b3041c0a00/0xdab2421a42e48d3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e48d33 expref: 3 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584126.027351:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b403b97400/0xdab2421a42e48d79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdab2421a42e48d72 expref: 2 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584126.027362:0:19525:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98b43e815800, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1784584126.027375:0:19525:0:(genops.c:906:class_export_put()) final put ffff98b43e815800/f92bc391-87f9-4f08-829f-ff6dbf39f6d6 00010000:00010000:2.0:1784584126.027394:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584126.027396:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584126.027398:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784584126.027434:0:473:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43e815800/f92bc391-87f9-4f08-829f-ff6dbf39f6d6 for MGS 00000020:00000080:0.0:1784584126.027460:0:473:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b418942800 for MGS 00000100:00100000:3.0:1784584126.027986:0:17180:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff98b303a84000:17180] 1 exiting: rc = 0 00000100:00100000:0.0:1784584126.028762:0:17181:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff98b303a85600:17181] 2 exiting: rc = 0 00000100:00100000:2.0:1784584126.029581:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.029594:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.029601:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.029606:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.029618:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.029624:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.029630:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.029635:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.029640:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.029646:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030218:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030225:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030230:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030237:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030242:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030253:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030260:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030266:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030271:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030277:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030282:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030288:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030293:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030299:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030305:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030310:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030322:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030328:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030333:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030337:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030343:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030348:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030354:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030359:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030364:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030369:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030373:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030378:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030383:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030397:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030402:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030408:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030413:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030419:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030425:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030431:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030436:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030441:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030447:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030453:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030458:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030462:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030575:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030582:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030588:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030593:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030598:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030603:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030609:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030615:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030621:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030629:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030637:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584126.030644:0:20757:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1784584126.034223:0:20757:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98b40678c9c0 - data ffff98b3020b4510/ffff98b303b61800 00000020:01000000:2.0:1784584126.034358:0:20757:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98b402ac4600 - data ffff98b420842bd0/ffff98b30429e400 00000020:00000080:2.0:1784584126.035681:0:20757:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e489f9 00000020:00000080:2.0:1784584126.035693:0:20757:0:(genops.c:906:class_export_put()) final put ffff98b43e963800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784584126.035773:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43e963800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:2.0:1784584126.036127:0:20757:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98b3041fd000 from MGS, refs=2 00000020:01000004:2.0:1784584126.036132:0:20757:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b3041fd000 2 00000020:01000004:2.0:1784584126.036135:0:20757:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98b3041fd000 from MGS 00000020:00000080:2.0:1784584126.036178:0:20757:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784584126.036185:0:20757:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1784584126.036196:0:20757:0:(genops.c:906:class_export_put()) final put ffff98b43e962800/MGS 00000020:00000080:2.0:1784584126.036198:0:20757:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43e962800/MGS for MGS 00000020:01000000:2.0:1784584126.036205:0:20757:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1784584126.036591:0:20757:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1784584126.036596:0:20757:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784584126.036602:0:20757:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784584126.036608:0:20757:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff98b43ca63800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784584126.036613:0:20757:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff98b4071acd40) has exports, disconnecting them 00000020:00080000:2.0:1784584126.036618:0:20757:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff98b43ca63800), last request at 1784584047 00000020:00000080:2.0:1784584126.036622:0:20757:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48afc 00000020:00080000:2.0:1784584126.036636:0:20757:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98b43ca63800): rc 0 00000020:00000080:2.0:1784584126.036641:0:20757:0:(genops.c:906:class_export_put()) final put ffff98b43ca63800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1784584126.037169:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43ca63800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1784584126.054559:0:20757:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1784584126.054567:0:20757:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784584126.054572:0:20757:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784584126.054579:0:20757:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784584126.054739:0:20757:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784584126.054747:0:20757:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1784584126.054756:0:20757:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b3041fd000 1 00000020:00000080:0.0:1784584126.054763:0:20757:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e489eb 00000020:00000080:0.0:1784584126.054771:0:20757:0:(genops.c:906:class_export_put()) final put ffff98b43e964800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1784584126.054777:0:20757:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1784584126.054783:0:20757:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784584126.054787:0:20757:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784584126.054790:0:20757:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff98b4049db380) has no exports 00000020:00000080:1.0:1784584126.056622:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b416bda800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1784584126.056635:0:36:0:(genops.c:906:class_export_put()) final put ffff98b43ca60800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1784584126.056639:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43ca60800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1784584126.056651:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1784584126.056756:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43e964800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1784584126.061787:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784584126.086195:0:20757:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784584126.086209:0:20757:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1784584126.086213:0:20757:0:(genops.c:906:class_export_put()) final put ffff98b3041ff000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784584126.086217:0:20757:0:(genops.c:865:class_export_destroy()) destroying export ffff98b3041ff000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1784584126.086228:0:20757:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1784584126.086338:0:20757:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98b3041fa800 00000020:02000400:0.0:1784584126.088360:0:20757:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:1.0:1784584126.127203:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784584126.127226:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599226112:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784584126.127291:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584126.127325:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599226112 00000100:00100000:2.0:1784584126.127334:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599226112 00000100:00100000:2.0:1784584126.127672:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784584126.127682:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599226112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784584126.127708:0:18696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784584126.128238:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599226112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 557us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584126.128246:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1784584126.128266:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784584126.128316:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599226112:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1784584127.087119:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584127.151616:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599226240:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784584127.151684:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584127.151737:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599226240 00000100:00100000:1.0:1784584127.151744:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599226240 00000100:00100000:1.0:1784584127.151778:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1784584127.151785:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1871271599226240:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1784584127.151799:0:17192:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784584127.151833:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1871271599226240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 47us (149us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784584127.151840:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:02020000:1.0:1784584127.151874:0:3640:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1784584127.163163:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784584127.163172:0:3640:0:(import.c:65:import_set_state_nolock()) ffff98b30376b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784584127.163176:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1784584127.193248:0:3640:0:(import.c:65:import_set_state_nolock()) ffff98b30376b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784584127.193270:0:3640:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 503 00000100:00080000:1.0:1784584127.193281:0:3640:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98b30376b000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:1.0:1784584127.193363:0:3640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b43efa9180 x1871271599226368/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784584127.194388:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599226368:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1784584127.194459:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584127.199076:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599226368 00000100:00100000:0.0:1784584127.199091:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599226368 00000100:00100000:0.0:1784584127.199195:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784584127.199203:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3638:x1871271599226368:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1784584127.199225:0:17927:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784584127.231810:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3638:x1871271599226368:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 32599us (37343us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784584127.231831:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1784584127.232697:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b30376b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784584127.232706:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784584127.232712:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599226368:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:2.0:1784584128.110161:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784584128.686049:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784584128.686056:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784584128.686060:0:36:0:(import.c:65:import_set_state_nolock()) ffff98b30376b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784584128.686068:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 570 00000100:00080000:2.0:1784584128.686073:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784584128.686080:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98b30376b000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784584128.686109:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b437691f80 x1871271599226624/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784584128.689112:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599226624:0@lo:38:kworker.0 00000100:00100000:3.0:1784584128.689178:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584128.689236:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599226752:0@lo:400:kworker.0 00000100:00100000:3.0:1784584128.689277:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584128.689294:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1871271599227264:0@lo:400:kworker.0 00000100:00100000:3.0:1784584128.689313:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584128.689331:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1784584128.689347:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3642:1871271599226496:0@lo:400:kworker.0 00000400:00000100:3.0:1784584128.689364:0:3642:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871271599226496 offset 0 length 224: 4 00000100:00100000:3.0:1784584128.689381:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1871271599227136:0@lo:400:kworker.0 00000100:00100000:3.0:1784584128.689399:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584128.689803:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599227264 00000100:00100000:3.0:1784584128.689811:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599227264 00000100:00100000:3.0:1784584128.689872:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599227136 00000100:00100000:3.0:1784584128.689876:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599227136 00000100:00100000:3.0:1784584128.689895:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784584128.689905:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871271599227264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584128.689959:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871271599227264:12345-0@lo:400:kworker.0 Request processed in 56us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584128.689967:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784584128.689994:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784584128.689999:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1871271599227136:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1784584128.690004:0:17188:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784584128.690038:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1871271599227136:12345-0@lo:400:kworker.0 Request processed in 37us (637us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784584128.690044:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784584128.690062:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599226752 00000100:00100000:3.0:1784584128.690065:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599226752 00000100:00100000:3.0:1784584128.690097:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784584128.690103:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599226752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584128.690132:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599226752:12345-0@lo:400:kworker.0 Request processed in 29us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584128.690138:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784584128.690155:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599226624 00000100:00100000:3.0:1784584128.690158:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599226624 00000100:00100000:3.0:1784584128.690174:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784584128.690178:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1871271599226624:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784584128.690194:0:17191:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784584128.690221:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1871271599226624:12345-0@lo:38:kworker.0 Request processed in 42us (1044us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784584128.690236:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1784584128.690692:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b30376b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784584128.690708:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784584128.690713:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599226624:0@lo:38:kworker.0 00000100:00080000:3.0:1784584128.690747:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1784584128.690750:0:3642:0:(import.c:65:import_set_state_nolock()) ffff98b3049d7000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1784584128.690753:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1784584128.694048:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784584128.694059:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784584128.694327:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599227008:0@lo:400:kworker.0 00000100:00100000:1.0:1784584128.694690:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584128.695101:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1871271599227520:0@lo:400:kworker.0 00000100:00100000:1.0:1784584128.695134:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584128.695166:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784584128.695172:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599226880:0@lo:400:kworker.0 00000100:00100000:1.0:1784584128.695204:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584128.695229:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1871271599227392:0@lo:400:kworker.0 00000100:00100000:1.0:1784584128.695270:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584128.695743:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599226880 00000100:00100000:0.0:1784584128.695750:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599226880 00000100:00100000:0.0:1784584128.695817:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784584128.695841:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599226880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584128.695908:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599226880:12345-0@lo:400:kworker.0 Request processed in 83us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584128.695916:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1784584128.695941:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784584128.696114:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599226880:0@lo:400:kworker.0 00000100:00100000:1.0:1784584128.696144:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599227008 00000100:00100000:1.0:1784584128.696148:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599227008 00000100:00100000:1.0:1784584128.696175:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599227520 00000100:00100000:1.0:1784584128.696178:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599227520 00000100:00100000:1.0:1784584128.696197:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599227392 00000100:00100000:1.0:1784584128.696199:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599227392 00000100:00100000:1.0:1784584128.696209:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784584128.696215:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871271599227520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584128.696253:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871271599227520:12345-0@lo:400:kworker.0 Request processed in 36us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584128.696260:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784584128.696271:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784584128.696275:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1871271599227008:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1784584128.696280:0:18716:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784584128.696304:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1871271599227008:12345-0@lo:400:kworker.0 Request processed in 27us (1614us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784584128.696309:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784584128.696319:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784584128.696323:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1871271599227392:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1784584128.696326:0:18716:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784584128.696494:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1871271599227392:12345-0@lo:400:kworker.0 Request processed in 169us (1223us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784584128.696500:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1784584128.696524:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784584128.696529:0:3640:0:(import.c:65:import_set_state_nolock()) ffff98b3048f4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784584128.696543:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1784584128.696549:0:3640:0:(import.c:65:import_set_state_nolock()) ffff98b3048f4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784584128.696552:0:3640:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 530 00000100:00080000:1.0:1784584128.696558:0:3640:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98b3048f4000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:1.0:1784584128.696583:0:3640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b43efa8000 x1871271599227776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784584128.696603:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1871271599227392:0@lo:400:kworker.0 00000100:00080000:1.0:1784584128.696616:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784584128.696619:0:3640:0:(import.c:65:import_set_state_nolock()) ffff98b405f4e000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784584128.696622:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1784584128.696625:0:3640:0:(import.c:65:import_set_state_nolock()) ffff98b405f4e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784584128.696628:0:3640:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 503 00000100:00080000:1.0:1784584128.696632:0:3640:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98b405f4e000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:1.0:1784584128.696643:0:3640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b43efab100 x1871271599227904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784584128.696652:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599227008:0@lo:400:kworker.0 00010000:00080000:1.0:1784584128.696663:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff98b437690380 x1871271599227520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584128.696671:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1871271599227520:0@lo:400:kworker.0 00000100:00100000:1.0:1784584128.696695:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1871271599227776:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1784584128.696721:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584128.696738:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1871271599227904:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1784584128.696766:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584128.696787:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599227776 00000100:00100000:1.0:1784584128.696790:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599227776 00000100:00100000:1.0:1784584128.696812:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599227904 00000100:00100000:1.0:1784584128.696815:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599227904 00000100:00100000:1.0:1784584128.696824:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784584128.696828:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1871271599227776:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1784584128.696851:0:18716:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784584128.696909:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1871271599227776:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 73us (181us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784584128.696916:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784584128.696928:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784584128.696932:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1871271599227904:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1784584128.696948:0:18716:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784584128.696988:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1871271599227904:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 54us (221us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784584128.696994:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1784584128.697030:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b3048f4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784584128.697034:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784584128.697037:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1871271599227776:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1784584128.697051:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b405f4e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784584128.697054:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784584128.697057:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1871271599227904:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1784584128.697104:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599227648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784584128.697154:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584128.697204:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599227648 00000100:00100000:1.0:1784584128.697214:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599227648 00000100:00100000:1.0:1784584128.697246:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784584128.697253:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599227648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784584128.697279:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1784584128.697321:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599227648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584128.697327:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784584128.697747:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599227648:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1784584128.697834:0:17182:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784584128.704691:0:3642:0:(import.c:65:import_set_state_nolock()) ffff98b3049d7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784584128.704703:0:3642:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 517 00000100:00080000:3.0:1784584128.704713:0:3642:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98b3049d7000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784584128.705259:0:3642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b437692300 x1871271599228032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784584128.705315:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1871271599228032:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1784584128.705666:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584128.705713:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599228032 00000100:00100000:3.0:1784584128.705720:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599228032 00000100:00100000:3.0:1784584128.705761:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784584128.705768:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1871271599228032:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1784584128.705788:0:18716:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784584128.705798:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1871271599227136:0@lo:400:kworker.0 00000100:00100000:3.0:1784584128.705826:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1871271599228032:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 57us (160us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784584128.705834:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1784584128.705903:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b3049d7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784584128.705907:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784584128.705911:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1871271599228032:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1784584128.706605:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599226752:0@lo:400:kworker.0 00010000:00080000:2.0:1784584128.706629:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff98b437692a00 x1871271599227264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584128.706641:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1871271599227264:0@lo:400:kworker.0 00010000:00010000:1.0:1784584129.134039:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1784584129.491195:0:20959:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1784584129.509634:0:20959:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1784584129.509685:0:20959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4172ce400/0xdab2421a42e48bea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48bf1 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584129.509708:0:20959:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4172ce400/0xdab2421a42e48bea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48bf1 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584129.509715:0:20959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4172ce400/0xdab2421a42e48bea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e48bf1 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584129.509722:0:20959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b4172ce400/0xdab2421a42e48bea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e48bf1 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584129.509739:0:20959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1784584129.509744:0:20959:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1784584129.509766:0:20959:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784584129.509770:0:20959:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1784584129.509774:0:20959:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1784584129.509789:0:20959:0:(import.c:65:import_set_state_nolock()) ffff98b405f4e000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1784584129.509793:0:20959:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784584129.509795:0:20959:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1784584129.509797:0:20959:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1784584129.511069:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584129.511082:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b4172ce400/0xdab2421a42e48bea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e48bf1 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584129.511093:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172ce400 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:3.0:1784584129.511096:0:17174:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b4172ce400/0xdab2421a42e48bea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e48bf1 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584129.511122:0:17174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b4172ce400/0xdab2421a42e48bea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e48bf1 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784584129.511129:0:17174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b4172ce400/0xdab2421a42e48bea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e48bf1 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584129.511134:0:17174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784584129.511137:0:17174:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1784584129.511140:0:17174:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1784584129.511181:0:17174:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b4172ce400/0xdab2421a42e48bea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e48bf1 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584129.511187:0:17174:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1784584129.511256:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c235880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3642:1871271599228160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784584129.511324:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784584129.511403:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b4172ce400/0xdab2421a42e48bea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e48bf1 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584129.511411:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b4172ce400/0xdab2421a42e48bea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e48bf1 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584129.511424:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584129.511426:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584129.511428:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584129.511825:0:20959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b3041c0e00/0xdab2421a42e48b49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48b50 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584129.511835:0:20959:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b3041c0e00/0xdab2421a42e48b49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48b50 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584129.511841:0:20959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b3041c0e00/0xdab2421a42e48b49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e48b50 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584129.511847:0:20959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b3041c0e00/0xdab2421a42e48b49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e48b50 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584129.511867:0:20959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784584129.511873:0:20959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48d72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48d79 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584129.511880:0:20959:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48d72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48d79 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584129.511886:0:20959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48d72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e48d79 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584129.511892:0:20959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48d72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e48d79 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584129.511904:0:20959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784584129.511920:0:20959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e48fd3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48fda expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584129.511927:0:20959:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e48fd3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48fda expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584129.511934:0:20959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e48fd3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e48fda expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584129.511940:0:20959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e48fd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e48fda expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584129.511949:0:20959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1784584129.511953:0:20959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b3041c0c00/0xdab2421a42e48b3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48b42 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584129.511960:0:20959:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b3041c0c00/0xdab2421a42e48b3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48b42 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584129.511965:0:20959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b3041c0c00/0xdab2421a42e48b3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e48b42 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584129.511971:0:20959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b3041c0c00/0xdab2421a42e48b3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e48b42 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584129.511978:0:20959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1784584129.511981:0:20959:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1784584129.512017:0:20959:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1784584129.512021:0:20959:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1784584129.512025:0:20959:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784584129.512030:0:20959:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1784584129.512040:0:20959:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff98b302467800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784584129.512046:0:20959:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff98b302b97000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784584129.512051:0:20959:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff98b4049d99c0) has exports, disconnecting them 00000020:00080000:0.0:1784584129.512055:0:20959:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff98b302467800), last request at 1784584128 00000020:00000080:0.0:1784584129.512062:0:20959:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48d64 00000100:00080000:0.0:1784584129.512079:0:20959:0:(import.c:65:import_set_state_nolock()) ffff98b302466800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1784584129.512122:0:20959:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98b302467800): rc 0 00000020:00000080:0.0:1784584129.512125:0:20959:0:(genops.c:906:class_export_put()) final put ffff98b302467800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1784584129.512135:0:20959:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff98b302b97000), last request at 1784584128 00000020:00000080:0.0:1784584129.512138:0:20959:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48cca 00000100:00080000:0.0:1784584129.512143:0:20959:0:(import.c:65:import_set_state_nolock()) ffff98b302b90000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1784584129.512152:0:473:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302467800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1784584129.512194:0:473:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b302466800 for lustre-MDT0001 00000020:00080000:0.0:1784584129.512205:0:20959:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98b302b97000): rc 0 00000020:00000080:0.0:1784584129.512208:0:20959:0:(genops.c:906:class_export_put()) final put ffff98b302b97000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1784584129.512217:0:20959:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbb9d4185bae0 00000020:00000080:0.0:1784584129.512230:0:473:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302b97000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1784584129.512252:0:473:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b302b90000 for lustre-MDT0001 00000100:00080000:0.0:1784584129.512269:0:20959:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784584129.512278:0:20959:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff98b43efa9c00 x1871271599226240/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784584143 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584129.512291:0:20959:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00100000:1.0:1784584129.512886:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599228160 00000100:00100000:1.0:1784584129.512896:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599228160 00000100:00100000:1.0:1784584129.512939:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784584129.512946:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437692a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3642:x1871271599228160:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1784584129.512953:0:17172:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784584129 with bad export cookie 15758730726681643541 00000100:00080000:0.0:1784584129.515289:0:20959:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1784584129.515300:0:20959:0:(import.c:65:import_set_state_nolock()) ffff98b30376b000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1784584129.515499:0:20959:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784584129.515503:0:20959:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1784584129.515519:0:20959:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1784584129.515591:0:20959:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1784584129.515613:0:20959:0:(import.c:65:import_set_state_nolock()) ffff98b43ed10000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1784584129.515629:0:20959:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784584129.515632:0:20959:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1784584129.515639:0:20959:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:3.0:1784584129.516452:0:19525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784584129.516463:0:19525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b3041c0e00/0xdab2421a42e48b49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e48b50 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584129.516488:0:19525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0e00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:3.0:1784584129.516493:0:19525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b3041c0e00/0xdab2421a42e48b49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e48b50 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584129.516518:0:19525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b3041c0e00/0xdab2421a42e48b49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e48b50 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784584129.516526:0:19525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b3041c0e00/0xdab2421a42e48b49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e48b50 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584129.516532:0:19525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784584129.516535:0:19525:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1784584129.516538:0:19525:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1784584129.516569:0:19525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b3041c0e00/0xdab2421a42e48b49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e48b50 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584129.516575:0:19525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784584129.516593:0:19525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b3041c0e00/0xdab2421a42e48b49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e48b50 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584129.516600:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b3041c0e00/0xdab2421a42e48b49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e48b50 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584129.516614:0:19525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784584129.516618:0:19525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48d72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e48d79 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584129.516624:0:19525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8800 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:3.0:1784584129.516627:0:19525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48d72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e48d79 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584129.516634:0:19525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48d72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e48d79 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784584129.516652:0:19525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48d72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e48d79 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584129.516658:0:19525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1784584129.516660:0:19525:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1784584129.516662:0:19525:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1784584129.516676:0:19525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48d72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e48d79 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584129.516682:0:19525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784584129.516688:0:19525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48d72 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e48d79 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584129.516708:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8800/0xdab2421a42e48d72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e48d79 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584129.516722:0:19525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784584129.516725:0:19525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e48fd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e48fda expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584129.516731:0:19525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1cc00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:3.0:1784584129.516734:0:19525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e48fd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e48fda expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584129.516740:0:19525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e48fd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e48fda expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784584129.516746:0:19525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e48fd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e48fda expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584129.516763:0:19525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1784584129.516765:0:19525:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1784584129.516767:0:19525:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1784584129.516784:0:19525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e48fd3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e48fda expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584129.516789:0:19525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:0.0:1784584129.516914:0:20959:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1784584129.516928:0:20959:0:(import.c:65:import_set_state_nolock()) ffff98b302bd1800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1784584129.516969:0:20959:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff98b4049d99c0) has no exports 00000100:00100000:2.0:1784584129.518144:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784584129.518162:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3642:1871271599228672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784584129.518227:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584129.518263:0:20758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599228672 00000100:00100000:2.0:1784584129.518269:0:20758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599228672 00000100:00100000:2.0:1784584129.518307:0:20758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784584129.518314:0:20758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437693b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3642:x1871271599228672:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1784584129.518321:0:20758:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784584129 with bad export cookie 15758730726681643541 00000100:00100000:2.0:1784584129.518391:0:20758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437693b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3642:x1871271599228672:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (163us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784584129.518399:0:20758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1784584129.518443:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.151@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1784584129.518457:0:3642:0:(import.c:65:import_set_state_nolock()) ffff98b404994800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1784584129.518461:0:3642:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.151@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:1.0:1784584129.521604:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584129.521614:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b3041c0c00/0xdab2421a42e48b3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e48b42 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584129.521627:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0c00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:1.0:1784584129.521631:0:17175:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b3041c0c00/0xdab2421a42e48b3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e48b42 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584129.521658:0:17175:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b3041c0c00/0xdab2421a42e48b3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e48b42 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784584129.521666:0:17175:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b3041c0c00/0xdab2421a42e48b3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e48b42 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584129.521672:0:17175:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1784584129.521674:0:17175:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1784584129.521678:0:17175:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1784584129.521770:0:19525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e48fd3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e48fda expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584129.521780:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e48fd3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e48fda expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584129.521797:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584129.521799:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584129.521800:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584129.521908:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784584129.533391:0:3642:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.151@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1784584129.533397:0:3642:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1784584129.533406:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98b437690e00 x1871271599226496/t0(0) o400->MGC192.168.203.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784584144 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584129.533420:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98b43c235880 x1871271599228160/t0(0) o103->MGC192.168.203.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784584145 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584129.533429:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98b302b47b80 x1871271599228672/t0(0) o103->MGC192.168.203.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784584145 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1784584129.533438:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1784584129.533441:0:3642:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1784584129.533443:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:1.0:1784584129.533510:0:17175:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b3041c0c00/0xdab2421a42e48b3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e48b42 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584129.533520:0:17175:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784584129.533541:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b3041c0c00/0xdab2421a42e48b3b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e48b42 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584129.533548:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b3041c0c00/0xdab2421a42e48b3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdab2421a42e48b42 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584129.533569:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584129.533572:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584129.533574:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584129.533601:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784584129.533617:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:0:1871271599228928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784584129.533903:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:0:1871271599228544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784584129.533913:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599226240:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784584129.534026:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437692a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3642:x1871271599228160:12345-0@lo:103:ldlm_bl.0 Request processed in 21078us (22701us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784584129.534036:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784584129.534105:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:0:1871271599228416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584129.534129:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599228288:0@lo:9:umount.0 00000100:00100000:3.0:1784584129.534167:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584129.534201:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599228800:0@lo:9:umount.0 00000100:00100000:3.0:1784584129.534222:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584129.534292:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599228288 00000100:00100000:1.0:1784584129.534300:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599228288 00000100:00100000:1.0:1784584129.534355:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599228800 00000100:00100000:1.0:1784584129.534359:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599228800 00000100:00100000:1.0:1784584129.534381:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784584129.534389:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1871271599228288:12345-0@lo:9:umount.0 00000020:00000080:1.0:1784584129.534425:0:18692:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48cf4 00000100:00080000:1.0:1784584129.534434:0:18692:0:(import.c:65:import_set_state_nolock()) ffff98b430f69800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784584129.534504:0:18692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1784584129.534626:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3638:x1871271599228288:12345-0@lo:9:umount.0 Request processed in 236us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584129.534633:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784584129.534647:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784584129.534654:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1871271599228800:12345-0@lo:9:umount.0 00000020:00000080:1.0:1784584129.534665:0:18692:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48d95 00000100:00080000:1.0:1784584129.534671:0:18692:0:(import.c:65:import_set_state_nolock()) ffff98b301f95000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784584129.534813:0:18692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1784584129.534938:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3638:x1871271599228800:12345-0@lo:9:umount.0 Request processed in 284us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584129.534945:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1784584129.535258:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43ed10000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1784584129.535272:0:3638:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1784584129.535274:0:3638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784584129.535279:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599228288:0@lo:9:umount.0 00000100:00080000:1.0:1784584129.535292:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b302bd1800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1784584129.535301:0:3638:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1784584129.535303:0:3638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784584129.535305:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599228800:0@lo:9:umount.0 00010000:00010000:1.0:1784584129.535335:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584129.535341:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784584129.536799:0:19508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784584129.536806:0:19508:0:(genops.c:906:class_export_put()) final put ffff98b301f91000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1784584129.536831:0:19508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784584129.536843:0:19508:0:(genops.c:906:class_export_put()) final put ffff98b301f90000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1784584129.537413:0:18688:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784584129.537416:0:18688:0:(genops.c:906:class_export_put()) final put ffff98b430f6b800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1784584129.537424:0:18688:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784584129.537427:0:18688:0:(genops.c:906:class_export_put()) final put ffff98b302464000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784584129.537555:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b301f91000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1784584129.537600:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b301f90000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1784584129.537613:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b430f6b800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1784584129.537625:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302464000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1784584129.537638:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b301f95000 for lustre-OST0001 00000020:00000080:0.0:1784584129.537644:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b301f97000 for lustre-OST0001 00000020:00000080:0.0:1784584129.537647:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b430f69800 for lustre-OST0000 00000020:00000080:0.0:1784584129.537649:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b302462800 for lustre-OST0000 00000100:00080000:2.0:1784584129.537839:0:3642:0:(import.c:65:import_set_state_nolock()) ffff98b404994800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784584129.537847:0:3642:0:(import.c:510:import_select_connection()) MGC192.168.203.151@tcp: connect to NID 0@lo last attempt 490 00000100:00080000:2.0:1784584129.537854:0:3642:0:(import.c:624:import_select_connection()) MGC192.168.203.151@tcp: import ffff98b404994800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784584129.537901:0:3642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b437690a80 x1871271599229056/t0(0) o250->MGC192.168.203.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784584129.537953:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3638:1871271599229056:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:1.0:1784584129.537999:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871271599229056 offset 0 length 520: 4 00000100:00100000:2.0:1784584129.538071:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c235880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3642:1871271599228160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784584129.538080:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3642:1871271599226496:0@lo:400:kworker.0 00000100:00100000:2.0:1784584129.538101:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3642:1871271599228672:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1784584129.547859:0:20959:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff98b4049d99c0) has no exports 00000020:01000000:0.0:1784584129.615418:0:20959:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98b302b67300 - data ffff98b41dcb0360/ffff98b43c2b8800 00000020:01000000:0.0:1784584129.615651:0:20959:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98b3036f4ae0 - data ffff98b41de2dca8/ffff98b405f1a800 00000001:00000004:2.0:1784584129.627561:0:20959:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1784584129.669129:0:20959:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784584129.669138:0:20959:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1784584129.669145:0:20959:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1784584129.672130:0:20959:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784584129.672138:0:20959:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1784584129.672208:0:20959:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784584129.672212:0:20959:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1784584129.672952:0:17928:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1784584129.672957:0:17928:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1784584129.672967:0:17928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1784584129.673503:0:20959:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784584129.673507:0:20959:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 4 00000004:00080000:0.0:1784584129.673520:0:20959:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784584129.673521:0:20959:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1784584129.673983:0:17930:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1784584129.673987:0:17930:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1784584129.673994:0:17930:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1784584129.674904:0:20959:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48b5e 00000020:00000080:0.0:1784584129.674913:0:20959:0:(genops.c:906:class_export_put()) final put ffff98b30376e800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1784584129.674989:0:473:0:(genops.c:865:class_export_destroy()) destroying export ffff98b30376e800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1784584129.675569:0:20959:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48b73 00000020:00000080:0.0:1784584129.675575:0:20959:0:(genops.c:906:class_export_put()) final put ffff98b4049d2000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1784584129.675591:0:20959:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1784584129.675597:0:20959:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784584129.675606:0:20959:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784584129.675610:0:20959:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff98b4049d8000) has no exports 00000020:00000080:3.0:1784584129.675723:0:473:0:(genops.c:865:class_export_destroy()) destroying export ffff98b4049d2000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:0.0:1784584129.675755:0:20959:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1784584129.675762:0:20959:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48bc7 00000020:00000080:0.0:1784584129.675766:0:20959:0:(genops.c:906:class_export_put()) final put ffff98b302bd6000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1784584129.675778:0:20959:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1784584129.675782:0:20959:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784584129.675786:0:20959:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784584129.675789:0:20959:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff98b4071a99c0) has no exports 00000020:00000080:0.0:1784584129.675793:0:20959:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48bc0 00000020:00000080:0.0:1784584129.675796:0:20959:0:(genops.c:906:class_export_put()) final put ffff98b302bd7800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1784584129.675807:0:473:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302bd6000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1784584129.675812:0:473:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302bd7800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1784584129.676101:0:20959:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1784584129.676105:0:20959:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784584129.676109:0:20959:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 5 00000004:00080000:0.0:1784584129.676114:0:20959:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784584129.676116:0:20959:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784584129.676153:0:20959:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784584129.676159:0:20959:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1784584129.676160:0:473:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b302bd1800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1784584129.676165:0:473:0:(genops.c:906:class_export_put()) final put ffff98b302bd2800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1784584129.676165:0:20959:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48bb2 00000020:00000080:3.0:1784584129.676167:0:473:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302bd2800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1784584129.676168:0:20959:0:(genops.c:906:class_export_put()) final put ffff98b302bd1000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1784584129.676172:0:473:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1784584129.676180:0:20959:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1784584129.676183:0:20959:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784584129.676191:0:20959:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784584129.676193:0:20959:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff98b43408b380) has no exports 00000020:00000080:0.0:1784584129.676197:0:20959:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48bab 00000020:00000080:0.0:1784584129.676201:0:20959:0:(genops.c:906:class_export_put()) final put ffff98b43ed14000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1784584129.676234:0:473:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302bd1000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1784584129.676239:0:473:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43ed14000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1784584129.676522:0:20959:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1784584129.676525:0:20959:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784584129.676528:0:20959:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1784584129.676531:0:20959:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784584129.676533:0:20959:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784584129.676565:0:20959:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784584129.676570:0:20959:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1784584129.676580:0:20959:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1784584129.676583:0:20959:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48b96 00000020:00000080:0.0:1784584129.676587:0:20959:0:(genops.c:906:class_export_put()) final put ffff98b43ed13000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1784584129.676592:0:20959:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1784584129.676595:0:20959:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784584129.676598:0:20959:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784584129.676601:0:20959:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff98b434088000) has no exports 00000020:00000080:0.0:1784584129.676604:0:20959:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48b8f 00000020:00000080:0.0:1784584129.676607:0:20959:0:(genops.c:906:class_export_put()) final put ffff98b30376b800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1784584129.676813:0:473:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b43ed10000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1784584129.676818:0:473:0:(genops.c:906:class_export_put()) final put ffff98b43ed10800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1784584129.676821:0:473:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43ed10800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1784584129.676824:0:473:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1784584129.676859:0:473:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43ed13000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1784584129.676864:0:473:0:(genops.c:865:class_export_destroy()) destroying export ffff98b30376b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1784584129.678558:0:20959:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1784584129.678566:0:20959:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784584129.678569:0:20959:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1784584129.678575:0:20959:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784584129.678628:0:20959:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784584129.678639:0:20959:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784584129.678665:0:20959:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784584129.678669:0:20959:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784584129.678674:0:20959:0:(genops.c:906:class_export_put()) final put ffff98b302b0e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784584129.678679:0:20959:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302b0e800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1784584129.678686:0:20959:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1784584129.678824:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b30376b000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1784584129.678831:0:38:0:(genops.c:906:class_export_put()) final put ffff98b4049d1800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1784584129.678833:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b4049d1800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1784584129.678837:0:20959:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48b7a 00000020:01000000:3.0:1784584129.678838:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784584129.678842:0:20959:0:(genops.c:906:class_export_put()) final put ffff98b4049d7800/lustre-MDD0001_UUID 00000020:01000000:1.0:1784584129.678851:0:20959:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1784584129.678855:0:20959:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784584129.678867:0:20959:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784584129.678870:0:20959:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff98b4340899c0) has no exports 00000020:00000080:1.0:1784584129.678887:0:20959:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784584129.678890:0:20959:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1784584129.678894:0:20959:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48b81 00000020:00000080:1.0:1784584129.678898:0:20959:0:(genops.c:906:class_export_put()) final put ffff98b4049d0800/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1784584129.678904:0:20959:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98b437661000 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1784584129.678908:0:20959:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b437661000 2 00000020:01000004:1.0:1784584129.678911:0:20959:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98b437661000 from lustre-MDT0001 00000020:00000080:1.0:1784584129.678925:0:20959:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784584129.678928:0:20959:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1784584129.678930:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b4049d7800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1784584129.678930:0:20959:0:(genops.c:906:class_export_put()) final put ffff98b30376f800/lustre-MDT0001_UUID 00000020:00000080:1.0:1784584129.678932:0:20959:0:(genops.c:865:class_export_destroy()) destroying export ffff98b30376f800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1784584129.678933:0:38:0:(genops.c:906:class_export_put()) final put ffff98b30376a000/lustre-MDD0001_UUID 00000020:00000080:3.0:1784584129.678935:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b30376a000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1784584129.678938:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:01000000:1.0:1784584129.678938:0:20959:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1784584129.678965:0:20959:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1784584129.678968:0:20959:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1784584129.678971:0:20959:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784584129.678973:0:20959:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1784584129.678979:0:20959:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff98b405f4e800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784584129.678983:0:20959:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff98b42e930000) has exports, disconnecting them 00000020:00080000:1.0:1784584129.678987:0:20959:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff98b405f4e800), last request at 1784584060 00000020:00000080:1.0:1784584129.678990:0:20959:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48bff 00000020:00080000:1.0:1784584129.679011:0:20959:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98b405f4e800): rc 0 00000020:00000080:1.0:1784584129.679015:0:20959:0:(genops.c:906:class_export_put()) final put ffff98b405f4e800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1784584129.679037:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b4049d0800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1784584129.679041:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b405f4e800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1784584129.721331:0:20959:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1784584129.721341:0:20959:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784584129.721346:0:20959:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1784584129.721352:0:20959:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784584129.721529:0:20959:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784584129.721538:0:20959:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1784584129.721544:0:20959:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b437661000 1 00000020:00000080:1.0:1784584129.721562:0:20959:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48b26 00000020:00000080:1.0:1784584129.721570:0:20959:0:(genops.c:906:class_export_put()) final put ffff98b437662000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1784584129.721575:0:20959:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1784584129.721579:0:20959:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784584129.721583:0:20959:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784584129.721587:0:20959:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff98b4049dcd40) has no exports 00000020:00000080:3.0:1784584129.723890:0:473:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b405f4e000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1784584129.723905:0:473:0:(genops.c:906:class_export_put()) final put ffff98b43ca6d800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1784584129.723924:0:473:0:(genops.c:865:class_export_destroy()) destroying export ffff98b43ca6d800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1784584129.723936:0:473:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1784584129.724022:0:473:0:(genops.c:865:class_export_destroy()) destroying export ffff98b437662000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1784584129.843218:0:20959:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784584129.843233:0:20959:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1784584129.843239:0:20959:0:(genops.c:906:class_export_put()) final put ffff98b437665800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1784584129.843244:0:20959:0:(genops.c:865:class_export_destroy()) destroying export ffff98b437665800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1784584129.843254:0:20959:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1784584129.843363:0:20959:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98b437661800 00000020:01000000:3.0:1784584129.843381:0:20959:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1784584129.843385:0:20959:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784584129.843388:0:20959:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1784584129.843392:0:20959:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff98b302a48000) has no exports 00000100:00100000:2.0:1784584129.843901:0:17186:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff98b418b1c000:17186] 0 exiting: rc = 1 00000100:00100000:2.0:1784584129.844034:0:17188:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff98b42c772600:17188] 2 exiting: rc = 0 00000100:00100000:0.0:1784584129.844137:0:17187:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff98b42c772200:17187] 1 exiting: rc = 0 00000100:00100000:0.0:1784584129.844382:0:18716:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff98b30392e000:18716] 3 exiting: rc = 0 00000100:00100000:2.0:1784584129.845344:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845353:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845372:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845378:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845384:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845391:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845397:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845403:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845408:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845414:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845419:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845424:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845429:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845434:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845439:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845445:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845450:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845457:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845463:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845593:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845599:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845605:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845609:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845614:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845619:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845624:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845630:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845635:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845640:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845645:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845650:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845655:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845661:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845665:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845671:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845690:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845698:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845711:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845717:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845724:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845730:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845735:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845741:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845747:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845752:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845756:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845761:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845767:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845772:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845777:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845782:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845788:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845794:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845800:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845806:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845812:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845817:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845823:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845830:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845836:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845841:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845847:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845852:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.845859:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584129.849516:0:17190:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff98b42c773200:17190] 1 exiting: rc = 0 00000100:00100000:2.0:1784584129.850671:0:17189:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff98b42c773a00:17189] 0 exiting: rc = 1 00000100:00100000:0.0:1784584129.852666:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852677:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852684:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852690:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852695:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852700:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852706:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852711:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852716:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852720:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852725:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852751:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852756:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852761:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852767:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852773:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852778:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852783:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852788:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852793:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852799:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852804:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852809:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852814:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852820:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852825:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852831:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852837:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852842:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852846:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852852:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852857:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852862:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852867:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852873:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852880:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852885:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852891:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852897:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852902:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852971:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852976:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852992:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.852998:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.853012:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.853016:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.853029:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.853035:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.853040:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.853045:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.853050:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.853055:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.853060:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.853065:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.853070:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.853075:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.853080:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.853085:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.853090:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.853096:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.853100:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.853106:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.853111:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.853116:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584129.854172:0:17927:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff98b3026a2800:17927] 2 exiting: rc = 0 00000100:00100000:3.0:1784584129.854283:0:17191:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff98b302b6ea00:17191] 0 exiting: rc = 1 00000100:00100000:1.0:1784584129.855301:0:17192:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff98b42c773600:17192] 1 exiting: rc = 0 00000100:00100000:0.0:1784584129.857260:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857270:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857276:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857282:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857287:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857293:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857299:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857305:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857310:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857326:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857332:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857339:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857344:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857350:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857355:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857361:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857367:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857386:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857391:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857397:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857402:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857421:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857427:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857433:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857439:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857444:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857451:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857456:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857462:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857618:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857626:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857633:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857639:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857660:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857667:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857673:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857679:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857686:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857691:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857696:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857702:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857708:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857713:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857718:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857724:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857744:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857752:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857758:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857763:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857769:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857778:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857784:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857798:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857804:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857810:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857817:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857822:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857843:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857850:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857856:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857863:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857869:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857876:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.857883:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584129.883866:0:17194:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff98b43e8ad400:17194] 1 exiting: rc = 0 00000100:00100000:1.0:1784584129.884084:0:17193:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff98b40a5b1c00:17193] 0 exiting: rc = 1 00000100:00100000:0.0:1784584129.884171:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884178:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884185:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884190:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884197:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884202:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884209:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884215:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884220:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884227:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884233:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884238:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884243:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884249:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884254:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884260:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884265:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884271:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884277:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884282:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884288:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884293:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884299:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884318:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884324:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884329:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884335:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884340:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884346:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884352:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884357:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884363:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884368:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884374:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884380:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884385:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884390:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884395:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884400:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884405:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884410:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884416:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884421:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884426:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884431:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884436:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884442:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884448:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884453:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884459:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884464:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884739:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884745:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884751:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884756:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884761:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884766:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884771:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884786:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884791:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884797:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884802:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884807:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.884813:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.885421:0:17195:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff98b43e8acc00:17195] 0 exiting: rc = 1 00000100:00100000:2.0:1784584129.892995:0:17196:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff98b43e8ad200:17196] 1 exiting: rc = 0 00000100:00100000:1.0:1784584129.893228:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893235:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893241:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893245:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893249:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893254:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893258:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893263:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893268:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893273:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893278:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893282:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893287:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893291:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893296:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893301:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893305:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893310:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893314:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893318:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893323:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893327:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893331:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893336:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893340:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893345:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893368:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893372:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893377:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893381:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893386:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893391:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893395:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893400:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893405:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893410:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893415:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893420:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893425:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893431:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893435:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893441:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893446:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893451:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893456:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893461:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893504:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893510:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893515:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893520:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893525:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893529:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893535:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893540:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893545:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893550:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893555:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893560:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893565:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893569:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893574:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893588:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893593:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893598:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.893953:0:17197:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff98b42e921c00:17197] 0 exiting: rc = 1 00000100:00100000:2.0:1784584129.894819:0:17198:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff98b303994e00:17198] 1 exiting: rc = 0 00000100:00100000:1.0:1784584129.894972:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.894978:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.894983:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.894989:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.894994:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895009:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895014:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895019:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895024:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895028:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895033:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895037:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895042:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895047:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895052:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895057:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895061:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895066:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895071:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895075:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895080:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895085:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895089:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895094:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895099:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895104:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895109:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895113:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895118:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895123:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895128:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895146:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895151:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895156:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895162:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895167:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895172:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895177:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895182:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895186:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895191:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895196:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895200:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895205:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895210:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895214:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895219:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895225:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895229:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895234:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895239:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895244:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895249:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895255:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895260:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895265:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895269:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895275:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895279:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895284:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895289:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895295:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895299:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584129.895306:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.898818:0:17199:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff98b42e920a00:17199] 0 exiting: rc = 1 00000100:00100000:2.0:1784584129.899395:0:17200:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff98b42e920400:17200] 1 exiting: rc = 0 00000100:00100000:1.0:1784584129.899881:0:17201:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff98b303995600:17201] 2 exiting: rc = 0 00000100:00100000:0.0:1784584129.901776:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.901787:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.901793:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.901799:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.901805:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.901822:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.901830:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.901836:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.901841:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.901846:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.901852:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.901858:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.901863:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.901868:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.901882:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.901889:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.901895:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.901901:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.903787:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.903813:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.903819:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.903826:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.903833:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.903839:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.903845:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.903851:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.903857:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.903883:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.903889:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.903896:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.903903:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.903970:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.903977:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.903985:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.903991:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.903998:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.904015:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.904023:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.904052:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.904060:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.904066:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.904074:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.904080:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.904087:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.904093:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.904099:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.904106:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.904112:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.904118:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.904125:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.904131:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.904137:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.904143:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.904149:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.904156:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.904161:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.904166:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.904171:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.904176:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.904182:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.904187:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.904192:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.904205:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584129.904211:0:20959:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1784584129.912196:0:20959:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784584129.912209:0:20959:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1784584129.912227:0:20959:0:(genops.c:906:class_export_put()) final put ffff98b404990000/MDS_uuid 00000020:00000080:2.0:1784584129.912232:0:20959:0:(genops.c:865:class_export_destroy()) destroying export ffff98b404990000/MDS_uuid for MDS 00000020:01000000:2.0:1784584129.912336:0:20959:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1784584129.912882:0:20959:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1784584130.165072:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584131.183884:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584132.208310:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1784584133.026779:0:21160:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1784584133.042788:0:21160:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1784584133.042849:0:21160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4172cf200/0xdab2421a42e48c99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48ca0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584133.042863:0:21160:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4172cf200/0xdab2421a42e48c99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48ca0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584133.042871:0:21160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4172cf200/0xdab2421a42e48c99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e48ca0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584133.042878:0:21160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b4172cf200/0xdab2421a42e48c99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e48ca0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584133.042900:0:21160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1784584133.042905:0:21160:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1784584133.042926:0:21160:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784584133.042930:0:21160:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1784584133.042935:0:21160:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1784584133.042941:0:21160:0:(import.c:65:import_set_state_nolock()) ffff98b3049d7000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1784584133.042945:0:21160:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784584133.042946:0:21160:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1784584133.042949:0:21160:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1784584133.043758:0:21160:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784584133.043761:0:21160:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1784584133.043765:0:21160:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1784584133.043783:0:21160:0:(import.c:65:import_set_state_nolock()) ffff98b3049d3800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1784584133.044053:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584133.044061:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b4172cf200/0xdab2421a42e48c99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e48ca0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584133.044081:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4172cf200 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:2.0:1784584133.044085:0:17175:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b4172cf200/0xdab2421a42e48c99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e48ca0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584133.044094:0:17175:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b4172cf200/0xdab2421a42e48c99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e48ca0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784584133.044101:0:17175:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b4172cf200/0xdab2421a42e48c99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e48ca0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584133.044107:0:17175:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784584133.044110:0:17175:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1784584133.044112:0:17175:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1784584133.044125:0:17175:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98b404994800 00010000:00010000:2.0:1784584133.044128:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b4172cf200/0xdab2421a42e48c99 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xdab2421a42e48ca0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584133.044135:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b4172cf200/0xdab2421a42e48c99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xdab2421a42e48ca0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584133.044146:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584133.044147:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584133.044162:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584133.045632:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1871271599229184:0@lo:39:umount.0 00000400:00000100:0.0:1784584133.045692:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871271599229184 offset 0 length 224: 4 00010000:00010000:1.0:1784584133.229717:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784584133.805659:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) f92bc391-87f9-4f08-829f-ff6dbf39f6d6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784584133.805669:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) f92bc391-87f9-4f08-829f-ff6dbf39f6d6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784584133.805672:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784584133.805675:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784584133.805679:0:38:0:(import.c:65:import_set_state_nolock()) ffff98b3048f4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784584133.805687:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 571 00000100:00080000:2.0:1784584133.805692:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784584133.805699:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98b3048f4000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784584133.805735:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b437690e00 x1871271599229312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784584133.805807:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1871271599229312:0@lo:38:kworker.0 00000400:00000100:0.0:1784584133.805878:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871271599229312 offset 0 length 520: 4 00000100:00100000:1.0:1784584133.807211:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784584133.807228:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1871271599229440:0@lo:400:kworker.0 00000400:00000100:1.0:1784584133.807268:0:3640:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871271599229440 offset 0 length 224: 4 00010000:00010000:3.0:1784584134.254163:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784584134.829587:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) f92bc391-87f9-4f08-829f-ff6dbf39f6d6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784584134.829606:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) f92bc391-87f9-4f08-829f-ff6dbf39f6d6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784584134.829609:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784584134.829612:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784584134.834235:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784584134.834263:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1871271599229568:0@lo:400:kworker.0 00000400:00000100:0.0:1784584134.834318:0:3639:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871271599229568 offset 0 length 224: 4 00010000:00010000:2.0:1784584135.278581:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584136.301799:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584137.325684:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784584137.840227:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) f92bc391-87f9-4f08-829f-ff6dbf39f6d6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784584137.840248:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) f92bc391-87f9-4f08-829f-ff6dbf39f6d6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784584137.840251:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784584137.840254:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784584137.840399:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599229696:0@lo:400:kworker.0 00000400:00000100:1.0:1784584137.840456:0:3641:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871271599229696 offset 0 length 224: 4 00010000:00010000:2.0:1784584138.353773:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584139.373596:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584139.951198:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784584129/real 1784584129] req@ffff98b437690a80 x1871271599229056/t0(0) o250->MGC192.168.203.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784584139 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584139.951240:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98b437690a80 x1871271599229056/t0(0) o250->MGC192.168.203.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784584139 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784584139.951259:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b404994800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784584139.951280:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1784584139.951284:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3638:1871271599229056:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:2.0:1784584139.951383:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) f92bc391-87f9-4f08-829f-ff6dbf39f6d6->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784584139.951390:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1784584139.951392:0:38:0:(import.c:65:import_set_state_nolock()) ffff98b404994800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784584139.951397:0:38:0:(import.c:510:import_select_connection()) MGC192.168.203.151@tcp: connect to NID 0@lo last attempt 572 00000100:00080000:2.0:1784584139.951401:0:38:0:(import.c:589:import_select_connection()) MGC192.168.203.151@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784584139.951408:0:38:0:(import.c:624:import_select_connection()) MGC192.168.203.151@tcp: import ffff98b404994800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784584139.951436:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b437693100 x1871271599229824/t0(0) o250->MGC192.168.203.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784584139.951516:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784584139.951521:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784584139.951567:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1871271599229952:0@lo:400:kworker.0 00000400:00000100:2.0:1784584139.951612:0:3642:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871271599229952 offset 0 length 224: 4 00000100:00100000:0.0:1784584139.951779:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437693100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3638:1871271599229824:0@lo:250:kworker.0 00000400:00000100:0.0:1784584139.951802:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871271599229824 offset 0 length 520: 4 00010000:00010000:3.0:1784584140.399397:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584141.421884:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584142.448131:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584143.021601:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784584133/real 1784584133] req@ffff98b43c8edf80 x1871271599229184/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784584143 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584143.021786:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98b43c8edf80 x1871271599229184/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784584143 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784584143.021822:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b3049d3800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1784584143.021902:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1871271599229184:0@lo:39:umount.0 00000100:00080000:2.0:1784584143.022024:0:21160:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784584143.022028:0:21160:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784584143.022033:0:21160:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1784584143.027284:0:21160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96600/0xdab2421a42e48c6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48c76 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584143.027303:0:21160:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96600/0xdab2421a42e48c6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48c76 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584143.027310:0:21160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b96600/0xdab2421a42e48c6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e48c76 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584143.027316:0:21160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b403b96600/0xdab2421a42e48c6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e48c76 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584143.027416:0:21160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584143.027425:0:21160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e48fc5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48fcc expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584143.027432:0:21160:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e48fc5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48fcc expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584143.027455:0:21160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e48fc5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e48fcc expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584143.027462:0:21160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e48fc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e48fcc expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584143.029640:0:19525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784584143.029652:0:19525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b403b96600/0xdab2421a42e48c6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e48c76 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584143.029663:0:19525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b96600 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:3.0:1784584143.029667:0:19525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b403b96600/0xdab2421a42e48c6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e48c76 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584143.029676:0:19525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b403b96600/0xdab2421a42e48c6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e48c76 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784584143.029700:0:19525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b403b96600/0xdab2421a42e48c6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e48c76 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584143.029705:0:19525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784584143.029708:0:19525:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:3.0:1784584143.029722:0:19525:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98b404994800 00010000:00010000:3.0:1784584143.029726:0:19525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b403b96600/0xdab2421a42e48c6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xdab2421a42e48c76 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584143.029732:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b403b96600/0xdab2421a42e48c6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xdab2421a42e48c76 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584143.029748:0:19525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584143.029752:0:19525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e48fc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e48fcc expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584143.029757:0:19525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1ce00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:3.0:1784584143.029760:0:19525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e48fc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e48fcc expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584143.029766:0:19525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e48fc5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e48fcc expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784584143.029772:0:19525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e48fc5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e48fcc expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584143.029778:0:19525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1784584143.029780:0:19525:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1784584143.029783:0:19525:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98b404994800 00010000:00010000:3.0:1784584143.029792:0:19525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e48fc5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdab2421a42e48fcc expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584143.029799:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584143.029800:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584143.029803:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584143.030166:0:21160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784584143.030173:0:21160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e48fc5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdab2421a42e48fcc expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584143.030186:0:21160:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1784584143.030192:0:21160:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1784584143.030195:0:21160:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:1.0:1784584143.030243:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784584143.030499:0:21160:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1784584143.030503:0:21160:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1784584143.030509:0:21160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784584143.030515:0:21160:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1784584143.030519:0:21160:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff98b4331e3380) has no exports 00000020:00080000:2.0:1784584143.030542:0:21160:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff98b4331e3380) has no exports 00000020:01000000:2.0:1784584143.032941:0:21160:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98b40678c2a0 - data ffff98b420832d80/ffff98b405d44000 00000020:01000000:2.0:1784584143.033090:0:21160:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98b40678c120 - data ffff98b409eb7360/ffff98b406006400 00100000:10000000:2.0:1784584143.042183:0:21160:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1784584143.056360:0:21160:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48c84 00000020:00000080:2.0:1784584143.056373:0:21160:0:(genops.c:906:class_export_put()) final put ffff98b302b95000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1784584143.056394:0:21160:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98b405f4d000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1784584143.056398:0:21160:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b405f4d000 2 00000020:01000004:2.0:1784584143.056402:0:21160:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98b405f4d000 from lustre-OST0000 00000020:00000080:2.0:1784584143.056425:0:21160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784584143.056435:0:21160:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1784584143.056446:0:21160:0:(genops.c:906:class_export_put()) final put ffff98b430f6e800/lustre-OST0000_UUID 00000020:00000080:2.0:1784584143.056449:0:21160:0:(genops.c:865:class_export_destroy()) destroying export ffff98b430f6e800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1784584143.056456:0:21160:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1784584143.056577:0:21160:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1784584143.056582:0:21160:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1784584143.056585:0:21160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784584143.056591:0:21160:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784584143.056597:0:21160:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff98b3049d0000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784584143.056602:0:21160:0:(genops.c:1574:class_disconnect_exports()) OBD device 23 (ffff98b43408cd40) has exports, disconnecting them 00000020:00080000:2.0:1784584143.056607:0:21160:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff98b3049d0000), last request at 1784584073 00000020:00000080:2.0:1784584143.056610:0:21160:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48cae 00000020:00080000:2.0:1784584143.056620:0:21160:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98b3049d0000): rc 0 00000020:00000080:2.0:1784584143.056624:0:21160:0:(genops.c:906:class_export_put()) final put ffff98b3049d0000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1784584143.056999:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302b95000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1784584143.057012:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b3049d0000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1784584143.058698:0:21160:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1784584143.058704:0:21160:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784584143.058708:0:21160:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1784584143.058714:0:21160:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784584143.058833:0:21160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784584143.058842:0:21160:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1784584143.058848:0:21160:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1784584143.058853:0:21160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784584143.058856:0:21160:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1784584143.058863:0:21160:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff98b42badd800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784584143.058870:0:21160:0:(genops.c:1574:class_disconnect_exports()) OBD device 24 (ffff98b302440000) has exports, disconnecting them 00000020:00080000:1.0:1784584143.058874:0:21160:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff98b42badd800), last request at 1784584073 00000020:00000080:1.0:1784584143.058879:0:21160:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48cc3 00000020:00080000:1.0:1784584143.058892:0:21160:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98b42badd800): rc 0 00000020:00000080:1.0:1784584143.058897:0:21160:0:(genops.c:906:class_export_put()) final put ffff98b42badd800/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1784584143.059655:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b3049d7000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1784584143.059665:0:38:0:(genops.c:906:class_export_put()) final put ffff98b3049d2000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1784584143.059667:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b3049d2000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1784584143.059673:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1784584143.059725:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b42badd800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1784584143.090574:0:21160:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1784584143.090582:0:21160:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784584143.090586:0:21160:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784584143.090593:0:21160:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784584143.090626:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b3049d3800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1784584143.090771:0:21160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784584143.090780:0:21160:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1784584143.090786:0:21160:0:(genops.c:906:class_export_put()) final put ffff98b3049d2800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1784584143.090795:0:21160:0:(genops.c:865:class_export_destroy()) destroying export ffff98b3049d2800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1784584143.090805:0:21160:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1784584143.090896:0:21160:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b405f4d000 1 00000020:00000080:2.0:1784584143.090902:0:21160:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48c61 00000020:00000080:2.0:1784584143.090909:0:21160:0:(genops.c:906:class_export_put()) final put ffff98b406071800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1784584143.090929:0:21160:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1784584143.090937:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff98b406071800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1784584143.090946:0:21160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784584143.090951:0:21160:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1784584143.090954:0:21160:0:(genops.c:1579:class_disconnect_exports()) OBD device 20 (ffff98b42e934d40) has no exports 00000020:00000080:2.0:1784584143.147951:0:21160:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784584143.147965:0:21160:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1784584143.147970:0:21160:0:(genops.c:906:class_export_put()) final put ffff98b405f49800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1784584143.147975:0:21160:0:(genops.c:865:class_export_destroy()) destroying export ffff98b405f49800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1784584143.147985:0:21160:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1784584143.148371:0:21160:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98b405f48000 00000020:02000400:2.0:1784584143.148415:0:21160:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1784584143.469784:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584144.493676:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784584145.070521:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) f92bc391-87f9-4f08-829f-ff6dbf39f6d6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784584145.070530:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) f92bc391-87f9-4f08-829f-ff6dbf39f6d6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784584145.070533:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784584145.070536:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784584145.070654:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784584145.070668:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1871271599230080:0@lo:400:kworker.0 00000400:00000100:1.0:1784584145.070724:0:3640:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871271599230080 offset 0 length 224: 4 00010000:00010000:1.0:1784584145.517790:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584146.541564:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784584146.686755:0:21362:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1784584146.714831:0:21362:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1784584146.714937:0:21362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b97e00/0xdab2421a42e48d33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48d3a expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584146.714958:0:21362:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b97e00/0xdab2421a42e48d33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48d3a expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584146.714966:0:21362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b97e00/0xdab2421a42e48d33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e48d3a expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584146.714973:0:21362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b403b97e00/0xdab2421a42e48d33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e48d3a expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584146.715028:0:21362:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784584146.715034:0:21362:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1784584146.715057:0:21362:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784584146.715068:0:21362:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98b437690e00 x1871271599229312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784584148 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584146.715084:0:21362:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784584146.715091:0:21362:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784584146.715096:0:21362:0:(import.c:65:import_set_state_nolock()) ffff98b3048f4000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1784584146.715101:0:21362:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784584146.715105:0:21362:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98b437690e00 x1871271599229312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784584148 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584146.715112:0:21362:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784584146.715139:0:21362:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:2.0:1784584146.715444:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1871271599229312:0@lo:38:kworker.0 00010000:00010000:3.0:1784584146.717644:0:19525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584146.717657:0:19525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b403b97e00/0xdab2421a42e48d33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e48d3a expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584146.717677:0:19525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b97e00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:3.0:1784584146.717682:0:19525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b403b97e00/0xdab2421a42e48d33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e48d3a expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584146.717692:0:19525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b403b97e00/0xdab2421a42e48d33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e48d3a expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784584146.717699:0:19525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b403b97e00/0xdab2421a42e48d33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e48d3a expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584146.717705:0:19525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784584146.717707:0:19525:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1784584146.717710:0:19525:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1784584146.717750:0:19525:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98b404994800 00010000:00010000:3.0:1784584146.717754:0:19525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b403b97e00/0xdab2421a42e48d33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdab2421a42e48d3a expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584146.717761:0:19525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b403b97e00/0xdab2421a42e48d33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdab2421a42e48d3a expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584146.717788:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584146.717790:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584146.717792:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784584146.717939:0:21362:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784584146.717951:0:21362:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98b437690700 x1871271599229440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584149 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584146.718005:0:21362:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98b437690000 x1871271599229568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584150 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584146.718027:0:21362:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98b43c8ed500 x1871271599229696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584153 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584146.718041:0:21362:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98b437692680 x1871271599229952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584155 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584146.718052:0:21362:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98b437692d80 x1871271599230080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584161 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584146.718058:0:21362:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784584146.718063:0:21362:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1784584146.718084:0:21362:0:(import.c:65:import_set_state_nolock()) ffff98b3048f1800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1784584146.718490:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1871271599229568:0@lo:400:kworker.0 00000100:00100000:3.0:1784584146.718538:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1871271599229952:0@lo:400:kworker.0 00000100:00100000:3.0:1784584146.718560:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599229696:0@lo:400:kworker.0 00000100:00100000:3.0:1784584146.718592:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1871271599230208:0@lo:39:umount.0 00000400:00000100:3.0:1784584146.718636:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871271599230208 offset 0 length 224: 4 00000100:00100000:0.0:1784584146.718950:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1871271599229440:0@lo:400:kworker.0 00000100:00100000:0.0:1784584146.718963:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1871271599230080:0@lo:400:kworker.0 00010000:00010000:1.0:1784584147.570953:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584148.589674:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584149.613710:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784584150.189647:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) f92bc391-87f9-4f08-829f-ff6dbf39f6d6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784584150.189657:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) f92bc391-87f9-4f08-829f-ff6dbf39f6d6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1784584150.637723:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584151.661609:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584152.685847:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584153.710157:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584154.733868:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584154.926380:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784584139/real 1784584139] req@ffff98b437693100 x1871271599229824/t0(0) o250->MGC192.168.203.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784584154 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584154.926416:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98b437693100 x1871271599229824/t0(0) o250->MGC192.168.203.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784584154 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784584154.926436:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b404994800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784584154.926462:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1784584154.926481:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437693100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3638:1871271599229824:0@lo:250:kworker.0 00000100:00080000:2.0:1784584154.926535:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) f92bc391-87f9-4f08-829f-ff6dbf39f6d6->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784584154.926541:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1784584154.926544:0:38:0:(import.c:65:import_set_state_nolock()) ffff98b404994800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784584154.926549:0:38:0:(import.c:510:import_select_connection()) MGC192.168.203.151@tcp: connect to NID 0@lo last attempt 583 00000100:00080000:2.0:1784584154.926554:0:38:0:(import.c:589:import_select_connection()) MGC192.168.203.151@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784584154.926576:0:38:0:(import.c:624:import_select_connection()) MGC192.168.203.151@tcp: import ffff98b404994800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784584154.926604:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b437690e00 x1871271599230336/t0(0) o250->MGC192.168.203.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784584154.926696:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3638:1871271599230336:0@lo:250:kworker.0 00000400:00000100:3.0:1784584154.926749:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871271599230336 offset 0 length 520: 4 00010000:00010000:3.0:1784584155.757667:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584156.781798:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584156.973842:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784584146/real 1784584146] req@ffff98b43efa8380 x1871271599230208/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784584156 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584156.973899:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98b43efa8380 x1871271599230208/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784584156 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784584156.973928:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b3048f1800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1784584156.973949:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1871271599230208:0@lo:39:umount.0 00000100:00080000:1.0:1784584156.974074:0:21362:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784584156.974088:0:21362:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784584156.974093:0:21362:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1784584156.975330:0:21362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b97800/0xdab2421a42e48d09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48d10 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584156.975347:0:21362:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b97800/0xdab2421a42e48d09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48d10 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584156.975367:0:21362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b403b97800/0xdab2421a42e48d09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e48d10 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584156.975375:0:21362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b403b97800/0xdab2421a42e48d09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e48d10 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584156.975402:0:21362:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784584156.975411:0:21362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e48fb7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e48fbe expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584156.975418:0:21362:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e48fb7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e48fbe expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584156.975425:0:21362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e48fb7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e48fbe expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584156.975430:0:21362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e48fb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdab2421a42e48fbe expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584156.975453:0:21362:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1784584156.975458:0:21362:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1784584156.975512:0:21362:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1784584156.975517:0:21362:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1784584156.975522:0:21362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784584156.975527:0:21362:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784584156.975531:0:21362:0:(genops.c:1579:class_disconnect_exports()) OBD device 26 (ffff98b4331e0000) has no exports 00000020:00080000:1.0:1784584156.975552:0:21362:0:(genops.c:1579:class_disconnect_exports()) OBD device 26 (ffff98b4331e0000) has no exports 00010000:00010000:3.0:1784584156.976067:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784584156.976074:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b403b97800/0xdab2421a42e48d09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e48d10 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584156.976092:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b403b97800 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:3.0:1784584156.976096:0:17174:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b403b97800/0xdab2421a42e48d09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e48d10 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584156.976104:0:17174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b403b97800/0xdab2421a42e48d09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e48d10 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784584156.976112:0:17174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b403b97800/0xdab2421a42e48d09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e48d10 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584156.976118:0:17174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784584156.976120:0:17174:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1784584156.976122:0:17174:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1784584156.976138:0:17174:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98b404994800 00010000:00010000:3.0:1784584156.976142:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b403b97800/0xdab2421a42e48d09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdab2421a42e48d10 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584156.976149:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b403b97800/0xdab2421a42e48d09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdab2421a42e48d10 expref: -99 pid: 19507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584156.976184:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584156.976187:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e48fb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e48fbe expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584156.976192:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1da00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:3.0:1784584156.976195:0:17174:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e48fb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdab2421a42e48fbe expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584156.976201:0:17174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e48fb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e48fbe expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784584156.976208:0:17174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e48fb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e48fbe expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584156.976213:0:17174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1784584156.976215:0:17174:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1784584156.976216:0:17174:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1784584156.976222:0:17174:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98b404994800 00010000:00010000:3.0:1784584156.976225:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e48fb7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xdab2421a42e48fbe expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584156.976231:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e48fb7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xdab2421a42e48fbe expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584156.976244:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584156.976245:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584156.976247:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584156.977256:0:19525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1784584156.983268:0:21362:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98b40678cc60 - data ffff98b409ef8798/ffff98b405d45c00 00000020:01000000:1.0:1784584156.983456:0:21362:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98b40678c840 - data ffff98b41df65af8/ffff98b302519400 00100000:10000000:1.0:1784584156.993626:0:21362:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1784584157.002737:0:21362:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48d1e 00000020:00000080:3.0:1784584157.002750:0:21362:0:(genops.c:906:class_export_put()) final put ffff98b302b93800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1784584157.002782:0:21362:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98b303408000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1784584157.002787:0:21362:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b303408000 2 00000020:01000004:3.0:1784584157.002790:0:21362:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98b303408000 from lustre-OST0001 00000020:00000080:3.0:1784584157.002815:0:21362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784584157.002835:0:21362:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1784584157.002839:0:21362:0:(genops.c:906:class_export_put()) final put ffff98b302b94000/lustre-OST0001_UUID 00000020:00000080:3.0:1784584157.002842:0:21362:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302b94000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1784584157.002850:0:21362:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:1.0:1784584157.002990:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302b93800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:3.0:1784584157.003077:0:21362:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import f92bc391-87f9-4f08-829f-ff6dbf39f6d6->MGS 00010000:00010000:3.0:1784584157.003245:0:21362:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b3041c1200/0xdab2421a42e48b2d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e48b34 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784584157.003259:0:21362:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b3041c1200/0xdab2421a42e48b2d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e48b34 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584157.003266:0:21362:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1784584157.003269:0:21362:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1784584157.003273:0:21362:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1784584157.003288:0:21362:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98b404994800 00010000:00010000:3.0:1784584157.003292:0:21362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b3041c1200/0xdab2421a42e48b2d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdab2421a42e48b34 expref: -99 pid: 17918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584157.003307:0:21362:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e48a1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdab2421a42e48a23 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784584157.003381:0:21362:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e48a1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdab2421a42e48a23 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584157.003387:0:21362:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784584157.003389:0:21362:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1784584157.003391:0:21362:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1784584157.003407:0:21362:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98b404994800 00010000:00010000:3.0:1784584157.003410:0:21362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b403b96000/0xdab2421a42e48a1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdab2421a42e48a23 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784584157.003427:0:21362:0:(import.c:65:import_set_state_nolock()) ffff98b404994800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1784584157.003431:0:21362:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1784584157.003433:0:21362:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1784584157.003435:0:21362:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1784584157.003439:0:21362:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1784584157.003450:0:21362:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98b437690e00 x1871271599230336/t0(0) o250->MGC192.168.203.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1784584174 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1784584157.006251:0:21362:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1784584157.006260:0:21362:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:2.0:1784584157.019456:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f92bc391-87f9-4f08-829f-ff6dbf39f6d6:3638:1871271599230336:0@lo:250:kworker.0 10000000:01000000:3.0:1784584157.019582:0:21362:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1784584157.019595:0:21362:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48a07 00000020:00000080:3.0:1784584157.019604:0:21362:0:(genops.c:906:class_export_put()) final put ffff98b404993800/f92bc391-87f9-4f08-829f-ff6dbf39f6d6 00000020:01000000:3.0:1784584157.019620:0:21362:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.151@tcp (flags='') 00000020:00000080:3.0:1784584157.019629:0:21362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784584157.019636:0:21362:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.151@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1784584157.019640:0:21362:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff98b302a499c0) has no exports 10000000:01000000:2.0:1784584157.020024:0:17184:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:1.0:1784584157.020157:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b404993800/f92bc391-87f9-4f08-829f-ff6dbf39f6d6 for MGC192.168.203.151@tcp 10000000:01000000:3.0:1784584157.020243:0:21362:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.151@tcp: client import never connected 00000100:00080000:3.0:1784584157.020247:0:21362:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1784584157.020250:0:21362:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1784584157.020253:0:21362:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1784584157.020255:0:21362:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1784584157.020303:0:21362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784584157.020310:0:21362:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.151@tcp (uuid f92bc391-87f9-4f08-829f-ff6dbf39f6d6) 00000020:01000000:3.0:1784584157.020318:0:21362:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1784584157.020322:0:21362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784584157.020326:0:21362:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784584157.020331:0:21362:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff98b3048f4800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784584157.020336:0:21362:0:(genops.c:1574:class_disconnect_exports()) OBD device 27 (ffff98b302444d40) has exports, disconnecting them 00000020:00080000:3.0:1784584157.020353:0:21362:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff98b3048f4800), last request at 1784584087 00000020:00000080:3.0:1784584157.020357:0:21362:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48d48 00000020:00080000:3.0:1784584157.020369:0:21362:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98b3048f4800): rc 0 00000020:00000080:3.0:1784584157.020374:0:21362:0:(genops.c:906:class_export_put()) final put ffff98b3048f4800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1784584157.021096:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b404994800 for MGC192.168.203.151@tcp 00000020:00000080:1.0:1784584157.021105:0:36:0:(genops.c:906:class_export_put()) final put ffff98b404997000/f92bc391-87f9-4f08-829f-ff6dbf39f6d6 00000020:00000080:1.0:1784584157.021108:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b404997000/f92bc391-87f9-4f08-829f-ff6dbf39f6d6 for MGC192.168.203.151@tcp 00000020:01000000:1.0:1784584157.021118:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.151@tcp (f92bc391-87f9-4f08-829f-ff6dbf39f6d6) 00000020:00000080:1.0:1784584157.021361:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b3048f4800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1784584157.021440:0:21362:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1784584157.021444:0:21362:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784584157.021448:0:21362:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784584157.021453:0:21362:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784584157.021571:0:21362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784584157.021578:0:21362:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1784584157.021583:0:21362:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1784584157.021587:0:21362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784584157.021591:0:21362:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784584157.021596:0:21362:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff98b3048f6000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784584157.021601:0:21362:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff98b302bf19c0) has exports, disconnecting them 00000020:00080000:2.0:1784584157.021605:0:21362:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff98b3048f6000), last request at 1784584087 00000020:00000080:2.0:1784584157.021609:0:21362:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48d5d 00000020:00080000:2.0:1784584157.021620:0:21362:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98b3048f6000): rc 0 00000020:00000080:2.0:1784584157.021624:0:21362:0:(genops.c:906:class_export_put()) final put ffff98b3048f6000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1784584157.022974:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b3048f4000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1784584157.022986:0:36:0:(genops.c:906:class_export_put()) final put ffff98b3049d4000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1784584157.022989:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b3049d4000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1784584157.022996:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1784584157.023056:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b3048f6000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1784584157.134525:0:21362:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1784584157.134532:0:21362:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784584157.134536:0:21362:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1784584157.134540:0:21362:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784584157.134565:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98b3048f1800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1784584157.134610:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1784584157.141874:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1784584157.142009:0:19525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1784584157.147618:0:17170:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff98b42c711800:17170] 1 exiting: rc = 0 00000100:00100000:2.0:1784584157.150905:0:17169:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff98b42c711200:17169] 0 exiting: rc = 1 00000100:00100000:1.0:1784584157.152645:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.153168:0:20758:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff98b40a268e00:20758] 3 exiting: rc = 0 00000100:00100000:0.0:1784584157.155000:0:17173:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff98b43ed33000:17173] 2 exiting: rc = 0 00000100:00100000:0.0:1784584157.155120:0:17172:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff98b42c710000:17172] 1 exiting: rc = 0 00000100:00100000:3.0:1784584157.155522:0:17171:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff98b42c710c00:17171] 0 exiting: rc = 1 00000100:00100000:1.0:1784584157.155800:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.155808:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.155813:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.155818:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.155835:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.155841:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.155859:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.155863:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.155868:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.155873:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.155878:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.155883:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.155888:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.155893:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.155899:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.155903:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.155908:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.155913:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.155923:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.155929:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.155934:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.155939:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.155944:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.155949:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.155959:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.155964:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.155969:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.155974:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.155978:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.155984:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.155989:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.155997:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.156002:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.156007:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.156012:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.156017:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.156022:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.156027:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.156032:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.156036:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.156041:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.156053:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.156058:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.156063:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.156068:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.156073:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.156077:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.156082:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.156087:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.156092:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.156098:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.156103:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.156107:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.156112:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.156117:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.156122:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.156126:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.156131:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.156136:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.156140:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.156145:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.156150:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.156154:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.156158:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1784584157.160997:0:21362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784584157.161014:0:21362:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1784584157.161021:0:21362:0:(genops.c:906:class_export_put()) final put ffff98b3048f0000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1784584157.161025:0:21362:0:(genops.c:865:class_export_destroy()) destroying export ffff98b3048f0000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1784584157.161031:0:21362:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1784584157.161086:0:21362:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b303408000 1 00000020:00000080:1.0:1784584157.161091:0:21362:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdab2421a42e48d02 00000020:00000080:1.0:1784584157.161097:0:21362:0:(genops.c:906:class_export_put()) final put ffff98b302b95800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1784584157.161154:0:21362:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1784584157.161165:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98b302b95800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1784584157.161176:0:21362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784584157.161190:0:21362:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784584157.161199:0:21362:0:(genops.c:1579:class_disconnect_exports()) OBD device 25 (ffff98b302443380) has no exports 00000020:00000080:1.0:1784584157.231223:0:21362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784584157.231236:0:21362:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1784584157.231241:0:21362:0:(genops.c:906:class_export_put()) final put ffff98b30340c800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1784584157.231245:0:21362:0:(genops.c:865:class_export_destroy()) destroying export ffff98b30340c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1784584157.231253:0:21362:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1784584157.231598:0:21362:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98b30340d000 00000020:01000000:1.0:1784584157.231619:0:21362:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1784584157.231623:0:21362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784584157.231628:0:21362:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784584157.231632:0:21362:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff98b4071ab380) has no exports 00000020:00000080:1.0:1784584157.231658:0:21362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784584157.231663:0:21362:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1784584157.231666:0:21362:0:(genops.c:906:class_export_put()) final put ffff98b406076000/OSS_uuid 00000020:00000080:1.0:1784584157.231668:0:21362:0:(genops.c:865:class_export_destroy()) destroying export ffff98b406076000/OSS_uuid for OSS 00000020:01000000:1.0:1784584157.231672:0:21362:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1784584157.231752:0:19378:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff98b30375c000:19378] 3 exiting: rc = 0 00000100:00080000:3.0:1784584157.231791:0:17182:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1784584157.231941:0:18694:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff98b406022200:18694] 2 exiting: rc = 0 00000100:00100000:3.0:1784584157.232000:0:18692:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff98b401284400:18692] 0 exiting: rc = 1 00000100:00100000:1.0:1784584157.232570:0:18693:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff98b42c4d7800:18693] 1 exiting: rc = 0 00000100:00100000:3.0:1784584157.232841:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.232851:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.232857:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.232874:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.232882:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.232888:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.232895:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.232901:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.232906:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.232916:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.232999:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233007:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233013:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233019:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233024:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233031:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233036:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233042:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233048:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233054:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233060:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233065:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233077:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233160:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233167:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233239:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233246:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233251:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233257:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233263:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233269:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233274:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233279:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233285:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233290:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233295:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233301:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233307:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233314:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233319:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233325:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233331:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233337:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233342:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233348:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233354:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233362:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233367:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233378:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233385:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233390:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233396:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233401:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233409:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233415:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233421:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233427:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233433:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233445:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233450:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233456:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233461:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233485:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.233492:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.235658:0:18696:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff98b30244da00:18696] 1 exiting: rc = 0 00000100:00100000:3.0:1784584157.236912:0:20736:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff98b43c2dba00:20736] 2 exiting: rc = 0 00000100:00100000:3.0:1784584157.236996:0:18695:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff98b405d31800:18695] 0 exiting: rc = 1 00000100:00100000:3.0:1784584157.237057:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237066:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237074:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237168:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237249:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237254:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237263:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237268:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237277:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237283:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237288:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237296:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237301:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237366:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237372:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237377:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237382:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237387:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237396:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237402:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237408:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237413:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237418:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237423:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237428:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237445:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237450:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237456:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237461:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237481:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237487:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237492:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237498:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237504:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237509:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237515:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237519:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237525:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237529:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237535:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237540:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237545:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237550:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237554:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237559:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237565:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237570:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237575:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237581:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237586:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237592:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237605:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237612:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237616:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237622:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237627:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237631:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237636:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237642:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237652:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237664:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237669:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237674:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.237679:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584157.247614:0:18699:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff98b417880800:18699] 2 exiting: rc = 0 00000100:00100000:1.0:1784584157.247671:0:18698:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff98b417880c00:18698] 1 exiting: rc = 0 00000100:00100000:2.0:1784584157.247848:0:18697:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff98b417881600:18697] 0 exiting: rc = 1 00000100:00100000:3.0:1784584157.248045:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248053:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248060:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248066:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248072:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248096:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248104:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248110:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248116:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248122:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248128:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248134:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248140:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248147:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248155:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248161:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248168:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248331:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248338:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248343:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248349:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248355:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248374:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248381:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248387:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248398:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248405:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248411:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248417:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248423:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248429:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248446:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248452:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248458:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248464:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248486:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248491:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248497:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248503:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248510:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248518:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248525:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248533:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248542:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248548:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248554:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248578:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248587:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248592:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248598:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248605:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248613:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248620:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248627:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248635:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248644:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248662:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248684:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248698:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248712:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248720:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248729:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248739:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584157.248752:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584157.266250:0:18700:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff98b417881a00:18700] 0 exiting: rc = 1 00000100:00100000:0.0:1784584157.271193:0:18701:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff98b417881400:18701] 1 exiting: rc = 0 00000100:00100000:1.0:1784584157.271336:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271344:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271349:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271354:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271359:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271364:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271370:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271376:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271382:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271387:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271392:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271397:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271402:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271421:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271426:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271431:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271436:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271440:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271445:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271450:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271454:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271459:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271508:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271516:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271522:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271527:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271532:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271537:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271542:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271547:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271551:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271556:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271561:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271566:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271571:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271576:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271581:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271587:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271592:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271598:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271604:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271608:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271613:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271618:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271623:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271627:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271631:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271636:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271649:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271654:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271659:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271664:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271669:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271675:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271680:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271685:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271691:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271696:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271702:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271707:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271713:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271718:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271724:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.271729:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.272329:0:18702:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff98b302423e00:18702] 0 exiting: rc = 1 00000100:00100000:0.0:1784584157.273117:0:18703:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff98b3034bd200:18703] 1 exiting: rc = 0 00000100:00100000:1.0:1784584157.273287:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273295:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273309:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273317:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273326:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273332:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273339:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273347:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273353:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273360:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273367:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273391:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273400:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273408:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273415:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273421:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273428:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273435:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273454:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273461:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273492:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273500:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273506:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273528:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273535:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273542:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273549:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273555:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273561:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273567:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273573:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273579:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273584:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273590:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273595:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273614:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273621:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273626:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273632:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273637:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273643:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273649:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273656:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273661:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273666:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273672:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273678:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273698:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273704:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273709:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273715:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273720:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273725:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273738:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273743:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273749:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273755:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273761:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273767:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273787:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273794:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273799:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273805:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584157.273818:0:21362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1784584157.288788:0:21362:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1784584174.393118:0:22127:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1784584184.596420:0:22726:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784584184.596426:0:22726:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1784584184.596428:0:22726:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1784584184.596576:0:22726:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff98b405f11000 00000020:01000004:3.0:1784584184.596594:0:22726:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1784584184.596602:0:22726:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1784584184.596616:0:22726:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff98b42e930000) 00000020:00000080:3.0:1784584184.596631:0:22726:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1784584184.690809:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1784584184.691337:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1784584184.702897:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1784584184.704384:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1784584184.704705:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1784584184.705309:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1784584184.707409:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1784584184.708817:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1784584184.709285:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1784584184.709596:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1784584184.710342:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1784584184.712623:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1784584184.713442:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1784584184.715347:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1784584184.719054:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1784584184.719656:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1784584184.720075:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1784584184.722316:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1784584184.722687:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1784584184.723179:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1784584184.723431:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1784584184.723685:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1784584184.723853:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1784584184.724082:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1784584184.724324:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1784584184.724581:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1784584184.724818:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1784584184.725082:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1784584184.725748:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1784584184.726090:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1784584184.726940:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1784584184.727313:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1784584184.727940:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1784584184.728338:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1784584184.728796:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1784584184.729343:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1784584184.729569:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1784584184.729808:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1784584184.730153:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1784584184.730496:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1784584184.730735:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1784584184.732344:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1784584184.732675:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1784584184.733354:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1784584184.734089:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1784584184.737151:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1784584184.741106:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1784584184.753769:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1784584184.756099:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1784584184.758390:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1784584184.760259:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1784584184.760697:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1784584184.761029:0:22726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:0.0:1784584184.761537:0:22726:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1784584184.761748:0:22726:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1784584184.761756:0:22726:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:0.0:1784584184.761776:0:22726:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdab2421a42e49273 00000020:01000004:0.0:1784584184.761783:0:22726:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1784584184.761787:0:22726:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1784584184.761792:0:22726:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98b405f11000 from MGS 00000020:01000004:0.0:1784584184.761795:0:22726:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1784584184.761805:0:22726:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff98b3024419c0) 00000020:00000080:0.0:1784584184.761814:0:22726:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1784584184.761877:0:22726:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98b405f11000 from MGS, refs=2 00080000:01000000:0.0:1784584184.761882:0:22726:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:0.0:1784584184.761886:0:22726:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdab2421a42e49281 00000100:00100000:0.0:1784584184.761977:0:22726:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1784584184.762081:0:22726:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1784584184.762087:0:22726:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1784584184.766351:0:22726:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1784584184.766363:0:22726:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1784584184.767237:0:22726:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784584184.767390:0:22726:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1784584184.767394:0:22726:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1784584184.768410:0:22726:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1784584184.768419:0:22726:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1784584184.789430:0:22726:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1784584184.789448:0:22726:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1784584184.796560:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584184.796566:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584184.796569:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584184.797284:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584184.797288:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584184.797290:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584184.800819:0:22726:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1784584184.803664:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1784584184.816422:0:22726:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1784584184.818722:0:22738:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1784584184.818793:0:22726:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1784584184.818844:0:22726:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784584184.822350:0:22726:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1784584184.822711:0:22726:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784584184.822860:0:22726:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1784584184.822865:0:22726:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1784584184.834551:0:22726:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1784584184.835841:0:22726:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1784584184.836864:0:22726:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1784584184.836876:0:22726:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1784584184.837725:0:22726:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1784584184.837745:0:22726:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.151@tcp' 00000020:01000004:2.0:1784584184.837746:0:22726:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1784584184.837775:0:22726:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.151@tcp (typ=mgc) 00000020:00000080:2.0:1784584184.837787:0:22726:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.151@tcp (ffff98b302bf0000) 00000020:00000080:2.0:1784584184.837803:0:22726:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1784584184.837880:0:22726:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b43c324800@MGC192.168.203.151@tcp: add connection 192.168.203.151@tcp at head 00000100:00080000:1.0:1784584184.838102:0:22743:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:2.0:1784584184.838293:0:22726:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.151@tcp-0 is initialized 00000040:01000000:2.0:1784584184.838300:0:22726:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.151@tcp ctxt 1 is initialized 10000000:01000000:1.0:1784584184.839911:0:22744:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1784584184.839989:0:22726:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.151@tcp (uuid 954867da-9a7c-4a17-b608-74c1de1cda93) 00000020:00000080:2.0:1784584184.840014:0:22726:0:(genops.c:1406:class_connect()) connect: client 954867da-9a7c-4a17-b608-74c1de1cda93, cookie 0xdab2421a42e4928f 00000100:00080000:2.0:1784584184.840024:0:22726:0:(import.c:510:import_select_connection()) MGC192.168.203.151@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784584184.840030:0:22726:0:(import.c:624:import_select_connection()) MGC192.168.203.151@tcp: import ffff98b43c324800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784584184.840061:0:22726:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b437690e00 x1871271599230464/t0(0) o250->MGC192.168.203.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784584184.840081:0:22726:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 954867da-9a7c-4a17-b608-74c1de1cda93->MGS 00000020:01000004:2.0:1784584184.840105:0:22726:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1784584184.840110:0:22726:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1784584184.840122:0:22726:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff98b302bf3380) 00000020:00000080:2.0:1784584184.840133:0:22726:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1784584184.841922:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:954867da-9a7c-4a17-b608-74c1de1cda93:3638:1871271599230464:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1784584184.842012:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584184.842171:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599230464 00000100:00100000:1.0:1784584184.842178:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599230464 00000100:00100000:1.0:1784584184.842218:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784584184.842225:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3638:x1871271599230464:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1784584184.842250:0:22740:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 954867da-9a7c-4a17-b608-74c1de1cda93@0@lo t0 exp 0000000000000000 cur 628 last 0 00000020:00000080:1.0:1784584184.842274:0:22740:0:(genops.c:1406:class_connect()) connect: client 954867da-9a7c-4a17-b608-74c1de1cda93, cookie 0xdab2421a42e4929d 00000100:00080000:1.0:1784584184.842392:0:22740:0:(import.c:65:import_set_state_nolock()) ffff98b437d09000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784584184.842441:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+5:3638:x1871271599230464:12345-0@lo:250:mount.lustre.0 Request processed in 215us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584184.842449:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784584184.842558:0:3638:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.151@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1784584184.842567:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.151@tcp: connect to target with instance 0 00000100:00080000:0.0:1784584184.842573:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.151@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1784584184.842578:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1784584184.842581:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43c324800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1784584184.842583:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1784584184.842598:0:3638:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1784584184.842604:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:954867da-9a7c-4a17-b608-74c1de1cda93:3638:1871271599230464:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1784584184.858383:0:22726:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784584184.858699:0:22726:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1784584184.858706:0:22726:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1784584184.864138:0:22726:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1784584184.864153:0:22726:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1784584184.865418:0:22726:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1784584184.865429:0:22726:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1784584184.866251:0:22726:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784584184.866414:0:22726:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1784584184.866420:0:22726:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1784584184.869313:0:22726:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1784584184.869321:0:22726:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1784584184.917948:0:22726:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784584184.918119:0:22726:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1784584184.918125:0:22726:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1784584184.919461:0:22726:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1784584184.919495:0:22726:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1784584184.920131:0:22726:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784584184.920538:0:22726:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1784584184.920544:0:22726:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1784584184.921455:0:22726:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1784584184.921464:0:22726:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1784584184.922744:0:22726:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784584184.922893:0:22726:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784584184.922898:0:22726:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1784584184.923811:0:22726:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784584184.923820:0:22726:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1784584184.924873:0:22726:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784584184.925133:0:22726:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784584184.925140:0:22726:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1784584184.928781:0:22726:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784584184.928793:0:22726:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1784584184.953336:0:22726:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784584184.953602:0:22726:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1784584184.953608:0:22726:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1784584184.955125:0:22726:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1784584184.955137:0:22726:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1784584184.956790:0:22726:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1784584184.956804:0:22726:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1784584184.958403:0:22726:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1784584184.958433:0:22726:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1784584184.958439:0:22726:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.151@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1784584184.958759:0:22726:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.151@tcp ctxt 0 is initialized 00000020:01000004:0.0:1784584184.958795:0:22726:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.151@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1784584184.958800:0:22726:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1784584184.958802:0:22726:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784584184.958803:0:22726:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784584184.958804:0:22726:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784584184.958805:0:22726:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784584184.958807:0:22726:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784584184.958808:0:22726:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784584184.958810:0:22726:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784584184.958812:0:22726:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784584184.958813:0:22726:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784584184.958816:0:22726:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1784584184.958818:0:22726:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784584184.958819:0:22726:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784584184.958820:0:22726:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784584184.958822:0:22726:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784584184.958823:0:22726:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784584184.958824:0:22726:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784584184.958825:0:22726:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784584184.958827:0:22726:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784584184.958828:0:22726:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784584184.958829:0:22726:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784584184.958864:0:22726:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1784584184.958888:0:22726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:22726:1871271599230592:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784584184.958956:0:22726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584184.959160:0:22726:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4067af300 going to sleep for 11 seconds 00000100:00100000:1.0:1784584184.959360:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599230592 00000100:00100000:1.0:1784584184.959368:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599230592 00000100:00100000:1.0:1784584184.959451:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784584184.959461:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+5:22726:x1871271599230592:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784584184.959548:0:22742:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784584184.959551:0:22742:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1784584184.959554:0:22742:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1784584184.959938:0:22763:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1784584184.960640:0:22742:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:0.0:1784584184.964954:0:22764:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1784584184.964962:0:22764:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1784584184.964965:0:22764:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1784584184.964967:0:22764:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1784584184.965446:0:22764:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1784584184.965932:0:22742:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784584184.965942:0:22742:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1784584184.968159:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+5:22726:x1871271599230592:12345-0@lo:253:mount.lustre.0 Request processed in 8685us (9187us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584184.968334:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784584184.968416:0:22726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:22726:1871271599230592:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784584184.968430:0:22726:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1784584184.968433:0:22726:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784584184.968435:0:22726:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784584184.968436:0:22726:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784584184.968437:0:22726:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784584184.968438:0:22726:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784584184.968439:0:22726:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784584184.968440:0:22726:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784584184.968442:0:22726:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784584184.968443:0:22726:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784584184.968444:0:22726:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784584184.968461:0:22726:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98b405f11000 from lustre-MDT0000 10000000:01000000:3.0:1784584184.968591:0:22726:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1784584184.968594:0:22726:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1784584184.968598:0:22726:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98b302bf0000 10000000:01000000:3.0:1784584184.968603:0:22726:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784584184.968620:0:22726:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff98b302bf0000 from 1 10000000:01000000:3.0:1784584184.968623:0:22726:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784584184.968734:0:22726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418983600/0xdab2421a42e492a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584184.968746:0:22726:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b418983600/0xdab2421a42e492a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584184.968756:0:22726:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b418983600/0xdab2421a42e492a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584184.968776:0:22726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:22726:1871271599230720:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784584184.968813:0:22726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584184.968875:0:22726:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b42e82a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784584184.968919:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599230720 00000100:00100000:0.0:1784584184.968926:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599230720 00000100:00100000:0.0:1784584184.969100:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784584184.969109:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+5:22726:x1871271599230720:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784584184.969121:0:22741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584184.969135:0:22741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b4332b9e00/0xdab2421a42e492ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e492a4 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584184.969173:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4332b9e00/0xdab2421a42e492ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e492a4 expref: 6 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584184.969185:0:22741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b4332b9e00/0xdab2421a42e492ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e492a4 expref: 6 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584184.969195:0:22741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b9e00, rc 0) 00000100:00100000:0.0:1784584184.969230:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+6:22726:x1871271599230720:12345-0@lo:101:mount.lustre.0 Request processed in 122us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584184.969238:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784584184.969592:0:22726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:22726:1871271599230720:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784584184.969608:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b418983600/0xdab2421a42e492a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e492ab expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584184.969618:0:22726:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b418983600/0xdab2421a42e492a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e492ab expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584184.969701:0:22726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437693800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:22726:1871271599230848:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584184.969728:0:22726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584184.969758:0:22726:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4170ecf00 going to sleep for 11 seconds 00000100:00100000:1.0:1784584184.969864:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599230848 00000100:00100000:1.0:1784584184.969869:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599230848 00000100:00100000:1.0:1784584184.969904:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784584184.969911:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+6:22726:x1871271599230848:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584184.969998:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+6:22726:x1871271599230848:12345-0@lo:501:mount.lustre.0 Request processed in 77us (258us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784584184.970006:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784584184.970526:0:22726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437693800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:22726:1871271599230848:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1784584184.970554:0:22726:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1784584184.970569:0:22726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418983600/0xdab2421a42e492a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e492ab expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584184.970578:0:22726:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b418983600/0xdab2421a42e492a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e492ab expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584184.970586:0:22726:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98b405f11000 10000000:01000000:2.0:1784584184.970591:0:22726:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1784584184.970602:0:22726:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98b405f11000 10000000:01000000:2.0:1784584184.970604:0:22726:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1784584184.970607:0:22726:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff98b405f11000 from 1 10000000:01000000:2.0:1784584184.970609:0:22726:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1784584184.970630:0:22726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a800/0xdab2421a42e492b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584184.970638:0:22726:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a800/0xdab2421a42e492b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584184.970661:0:22726:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a800/0xdab2421a42e492b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584184.970675:0:22726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437693800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:22726:1871271599230976:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784584184.970704:0:22726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584184.970716:0:22726:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4170ecf00 going to sleep for 11 seconds 00000100:00100000:0.0:1784584184.970900:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599230976 00000100:00100000:0.0:1784584184.970904:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599230976 00000100:00100000:0.0:1784584184.970969:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784584184.970977:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+6:22726:x1871271599230976:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784584184.970985:0:22741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584184.971007:0:22741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b4332b8c00/0xdab2421a42e492b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e492b2 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584184.971025:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4332b8c00/0xdab2421a42e492b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e492b2 expref: 7 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584184.971034:0:22741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b4332b8c00/0xdab2421a42e492b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e492b2 expref: 7 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584184.971041:0:22741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b8c00, rc 0) 00000100:00100000:0.0:1784584184.971080:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+7:22726:x1871271599230976:12345-0@lo:101:mount.lustre.0 Request processed in 104us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584184.971086:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784584184.971142:0:22726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437693800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:22726:1871271599230976:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784584184.971409:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a800/0xdab2421a42e492b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e492b9 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584184.971418:0:22726:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a800/0xdab2421a42e492b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e492b9 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584184.971429:0:22726:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1784584184.971448:0:22726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a800/0xdab2421a42e492b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e492b9 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584184.971456:0:22726:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a800/0xdab2421a42e492b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e492b9 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584184.971501:0:22726:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1784584184.971521:0:22726:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784584184.971527:0:22726:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98b405f11000 10000000:01000000:2.0:1784584184.971530:0:22726:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1784584184.971533:0:22726:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1784584184.971535:0:22726:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1784584184.971551:0:22726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a400/0xdab2421a42e492c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584184.971559:0:22726:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a400/0xdab2421a42e492c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584184.971567:0:22726:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a400/0xdab2421a42e492c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584184.971579:0:22726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437693800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:22726:1871271599231104:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784584184.971603:0:22726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584184.971901:0:22726:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4170ecf00 going to sleep for 11 seconds 00000100:00100000:1.0:1784584184.971974:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599231104 00000100:00100000:1.0:1784584184.971980:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599231104 00000100:00100000:1.0:1784584184.972102:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784584184.972109:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+7:22726:x1871271599231104:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784584184.972117:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584184.972127:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b303b1c600/0xdab2421a42e492c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e492c0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584184.972143:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b303b1c600/0xdab2421a42e492c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e492c0 expref: 8 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584184.972160:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b303b1c600/0xdab2421a42e492c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e492c0 expref: 8 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584184.972331:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1c600, rc 0) 00000100:00100000:1.0:1784584184.972376:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+8:22726:x1871271599231104:12345-0@lo:101:mount.lustre.0 Request processed in 267us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584184.972390:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784584184.972486:0:22726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437693800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:22726:1871271599231104:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784584184.972499:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a400/0xdab2421a42e492c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e492c7 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584184.972507:0:22726:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a400/0xdab2421a42e492c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e492c7 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584184.972557:0:22726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437693800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:22726:1871271599231232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584184.972582:0:22726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584184.972610:0:22726:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4170ecf00 going to sleep for 11 seconds 00000100:00100000:1.0:1784584184.972730:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599231232 00000100:00100000:1.0:1784584184.972734:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599231232 00000100:00100000:1.0:1784584184.972753:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784584184.972759:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+8:22726:x1871271599231232:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584184.972923:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+9:22726:x1871271599231232:12345-0@lo:501:mount.lustre.0 Request processed in 163us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584184.972931:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784584184.973416:0:22726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437693800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:22726:1871271599231232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584184.973446:0:22726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437693800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:22726:1871271599231360:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784584184.973517:0:22726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584184.973581:0:22726:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4170ecf00 going to sleep for 11 seconds 00000100:00100000:3.0:1784584184.973731:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599231360 00000100:00100000:3.0:1784584184.973736:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599231360 00000100:00100000:1.0:1784584184.973806:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784584184.973870:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+9:22726:x1871271599231360:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784584184.975083:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+9:22726:x1871271599231360:12345-0@lo:503:mount.lustre.0 Request processed in 1266us (1561us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584184.975095:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784584184.975205:0:22726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437693800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:22726:1871271599231360:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784584184.975811:0:22765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:954867da-9a7c-4a17-b608-74c1de1cda93:22765:1871271599231488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784584184.975856:0:22765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584184.975881:0:22765:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a2d4900 going to sleep for 11 seconds 00000100:00100000:1.0:1784584184.976097:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599231488 00000100:00100000:1.0:1784584184.976103:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599231488 00000100:00100000:1.0:1784584184.976143:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784584184.976166:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+9:22765:x1871271599231488:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784584184.977460:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+9:22765:x1871271599231488:12345-0@lo:502:llog_process_th.0 Request processed in 1296us (1598us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584184.977492:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784584184.977608:0:22765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:954867da-9a7c-4a17-b608-74c1de1cda93:22765:1871271599231488:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784584184.977635:0:22765:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584184.977659:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584184.977662:0:22765:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1784584184.977667:0:22765:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1784584184.977670:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784584184.977692:0:22765:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff98b302443380) 00000020:00000080:0.0:1784584184.977708:0:22765:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1784584184.977714:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1784584184.977788:0:22765:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:0.0:1784584184.977797:0:22765:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdab2421a42e492d5 00000020:00000080:0.0:1784584184.977983:0:22765:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1784584184.977987:0:22765:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584184.978005:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584184.978007:0:22765:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1784584184.978010:0:22765:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584184.978013:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584184.978015:0:22765:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1784584184.978018:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784584184.978026:0:22765:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff98b302444d40) 00000020:00000080:0.0:1784584184.978037:0:22765:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1784584184.978041:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1784584184.978043:0:22765:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1784584184.978045:0:22765:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1784584184.978050:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784584184.978105:0:22765:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98b405f11000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1784584184.978117:0:22765:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff98b302440000) 00000020:00000080:0.0:1784584184.978127:0:22765:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1784584184.978543:0:22765:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1784584184.978551:0:22765:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdab2421a42e492ea 00000020:00000080:0.0:1784584184.978708:0:22765:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1784584184.978715:0:22765:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1784584184.978720:0:22765:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xdab2421a42e492f1 00080000:01000000:0.0:1784584184.978724:0:22765:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:0.0:1784584184.978728:0:22765:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdab2421a42e492f8 00010000:00010000:2.0:1784584185.102052:0:22765:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1784584185.102810:0:22765:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:2.0:1784584185.103461:0:22765:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1784584185.103943:0:22765:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff98b302bf4d40) 00000020:00000080:2.0:1784584185.103961:0:22765:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1784584185.104041:0:22765:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:2.0:1784584185.104050:0:22765:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdab2421a42e49306 00000020:00000080:3.0:1784584185.106638:0:22765:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1784584185.120783:0:22765:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xdab2421a42e4930d 00000020:00000080:2.0:1784584185.121420:0:22765:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1784584185.121435:0:22765:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584185.121442:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584185.121444:0:22765:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1784584185.121447:0:22765:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784584185.121450:0:22765:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1784584185.121451:0:22765:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784584185.121453:0:22765:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784584185.121454:0:22765:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784584185.121456:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584185.121457:0:22765:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784584185.121459:0:22765:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584185.121463:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584185.122609:0:22765:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1784584185.122621:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1784584185.122738:0:22765:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1784584185.122758:0:22765:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584185.122761:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584185.122762:0:22765:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1784584185.122764:0:22765:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584185.122769:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584185.122770:0:22765:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1784584185.122772:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784584185.122777:0:22765:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.151@tcp to nid 0x20000c0a8cb97 (192.168.203.151@tcp) 00000020:00000080:2.0:1784584185.122803:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784584185.122821:0:22765:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff98b302bf19c0) 00000020:00000080:2.0:1784584185.122839:0:22765:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1784584185.122844:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784584185.122900:0:22765:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1784584185.122906:0:22765:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:2.0:1784584185.122912:0:22765:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdab2421a42e4931b 00010000:00080000:2.0:1784584185.122945:0:22765:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b3040b2000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.151@tcp at head 00010000:00010000:2.0:1784584185.126620:0:22765:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1784584185.129871:0:22765:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784584185.129885:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1784584185.129926:0:22765:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1784584185.129960:0:22765:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdab2421a42e49322 00000100:00080000:0.0:1784584185.129970:0:22765:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784584185.129977:0:22765:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98b3040b2000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:0.0:1784584185.130039:0:22765:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b43c8ed880 x1871271599231616/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784584185.130071:0:22765:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1784584185.130127:0:22765:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584185.130131:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584185.130133:0:22765:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1784584185.130136:0:22765:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784584185.130139:0:22765:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1784584185.130140:0:22765:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784584185.130149:0:22765:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784584185.130151:0:22765:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784584185.130154:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584185.130155:0:22765:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784584185.130158:0:22765:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784584185.130169:0:22765:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1784584185.130173:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584185.130174:0:22765:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1784584185.130178:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784584185.130181:0:22765:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.151@tcp to nid 0x20000c0a8cb97 (192.168.203.151@tcp) 00000020:01000000:0.0:1784584185.130204:0:22765:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1784584185.130206:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784584185.130219:0:22765:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98b4049dcd40) 00000020:00000080:0.0:1784584185.130231:0:22765:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1784584185.130235:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1784584185.130501:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599231616:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784584185.130564:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1784584185.130737:0:22765:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1784584185.130743:0:22765:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000020:00000080:0.0:1784584185.130749:0:22765:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdab2421a42e49330 00010000:00080000:0.0:1784584185.130776:0:22765:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b416bde800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.151@tcp at head 00010000:00010000:0.0:1784584185.130981:0:22765:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1784584185.131704:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599231616 00000100:00100000:3.0:1784584185.131713:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599231616 00000100:00100000:3.0:1784584185.131752:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784584185.131760:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1871271599231616:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1784584185.131775:0:22752:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:0.0:1784584185.135849:0:22765:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784584185.136094:0:22765:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1784584185.143812:0:22765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784584185.147054:0:22765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1784584185.155754:0:22765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:1.0:1784584185.156320:0:22771:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1784584185.156325:0:22771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1784584185.158315:0:22765:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784584185.158331:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784584185.158370:0:22765:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1784584185.158390:0:22765:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdab2421a42e49337 00000100:00080000:2.0:1784584185.158400:0:22765:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784584185.158406:0:22765:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98b416bde800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784584185.158441:0:22765:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b437690e00 x1871271599231744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784584185.158509:0:22765:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1784584185.158592:0:22765:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584185.158597:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584185.158598:0:22765:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1784584185.158601:0:22765:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784584185.158604:0:22765:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1784584185.158605:0:22765:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784584185.158607:0:22765:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784584185.158608:0:22765:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784584185.158610:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584185.158611:0:22765:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784584185.158614:0:22765:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784584185.158617:0:22765:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1784584185.158621:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584185.158622:0:22765:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1784584185.158625:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784584185.158628:0:22765:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.151@tcp to nid 0x20000c0a8cb97 (192.168.203.151@tcp) 00000020:01000000:2.0:1784584185.158909:0:22765:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1784584185.158913:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784584185.158928:0:22765:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98b4071ab380) 00000020:00000080:2.0:1784584185.158941:0:22765:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1784584185.158946:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784584185.159001:0:22765:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1784584185.159007:0:22765:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:2.0:1784584185.159012:0:22765:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdab2421a42e49345 00010000:00080000:2.0:1784584185.159043:0:22765:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b3041fd000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.151@tcp at head 00010000:00010000:2.0:1784584185.159304:0:22765:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1784584185.159371:0:22765:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1784584185.159385:0:22765:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1784584185.159933:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599231744:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1784584185.159994:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871271599231744 offset 0 length 520: 4 00000040:00080000:2.0:1784584185.164367:0:22765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784584185.165904:0:22765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1784584185.166123:0:22765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:0.0:1784584185.167442:0:22773:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1784584185.167447:0:22773:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1784584185.168761:0:22765:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784584185.168774:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784584185.168810:0:22765:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1784584185.168831:0:22765:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdab2421a42e4934c 00000100:00080000:2.0:1784584185.168841:0:22765:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784584185.168847:0:22765:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98b3041fd000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784584185.168881:0:22765:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b437691500 x1871271599231872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784584185.168909:0:22765:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1784584185.168959:0:22765:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584185.168964:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584185.168965:0:22765:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1784584185.168968:0:22765:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584185.168971:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584185.168973:0:22765:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784584185.168975:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784584185.168977:0:22765:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784584185.168979:0:22765:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584185.168982:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584185.168983:0:22765:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1784584185.168985:0:22765:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584185.168988:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584185.168989:0:22765:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784584185.168993:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1784584185.169034:0:22765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437693b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:954867da-9a7c-4a17-b608-74c1de1cda93:22765:1871271599232000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784584185.169068:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437691500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599231872:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1784584185.171495:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871271599231872 offset 0 length 520: 4 00000100:00100000:2.0:1784584185.177336:0:22765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584185.177400:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599232000 00000100:00100000:0.0:1784584185.177409:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599232000 00000100:00100000:2.0:1784584185.177422:0:22765:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b30401ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1784584185.177461:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784584185.177506:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+9:22765:x1871271599232000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784584185.177772:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+9:22765:x1871271599232000:12345-0@lo:502:llog_process_th.0 Request processed in 301us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584185.177780:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784584185.178014:0:22765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437693b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:954867da-9a7c-4a17-b608-74c1de1cda93:22765:1871271599232000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784584185.178043:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1871271599231616:12345-0@lo:38:llog_process_th.0 Request processed in 46282us (47477us total) trans 0 rc -19/-19 00000020:01000000:2.0:1784584185.178048:0:22765:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:3.0:1784584185.178052:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:00000080:2.0:1784584185.178059:0:22765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584185.178061:0:22765:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784584185.178065:0:22765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1784584185.178175:0:22726:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1784584185.178195:0:22726:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1784584185.178215:0:22726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a400/0xdab2421a42e492c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e492c7 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584185.178237:0:22726:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a400/0xdab2421a42e492c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e492c7 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584185.178254:0:22726:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98b405f11000 from 1 10000000:01000000:3.0:1784584185.178257:0:22726:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784584185.178287:0:22726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982c00/0xdab2421a42e49353 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584185.178294:0:22726:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b418982c00/0xdab2421a42e49353 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584185.178303:0:22726:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b418982c00/0xdab2421a42e49353 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584185.178322:0:22726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:22726:1871271599232128:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784584185.178352:0:22726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584185.178380:0:22726:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b42e82a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584185.178515:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599232128 00000100:00100000:2.0:1784584185.178520:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599232128 00000100:00100000:2.0:1784584185.178547:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784584185.178553:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+9:22726:x1871271599232128:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784584185.178563:0:22741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584185.178576:0:22741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ea7ac00/0xdab2421a42e4935a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e49353 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584185.178595:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ea7ac00/0xdab2421a42e4935a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e49353 expref: 10 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784584185.178597:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b3040b2000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784584185.178601:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00010000:00010000:2.0:1784584185.178605:0:22741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ea7ac00/0xdab2421a42e4935a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e49353 expref: 10 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584185.178605:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599231616:0@lo:38:llog_process_th.0 00010000:00010000:2.0:1784584185.178614:0:22741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7ac00, rc 0) 00000100:00100000:2.0:1784584185.178657:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+10:22726:x1871271599232128:12345-0@lo:101:mount.lustre.0 Request processed in 104us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584185.178664:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784584185.178789:0:22726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:22726:1871271599232128:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784584185.178801:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b418982c00/0xdab2421a42e49353 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4935a expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584185.178810:0:22726:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b418982c00/0xdab2421a42e49353 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e4935a expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584185.179371:0:22726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:22726:1871271599232256:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1784584185.179410:0:22726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584185.179438:0:22726:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a546cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584185.179513:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599232256 00000100:00100000:2.0:1784584185.179518:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599232256 00000100:00100000:2.0:1784584185.179554:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784584185.179561:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+10:22726:x1871271599232256:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1784584185.179574:0:22742:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1784584185.179580:0:22742:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1784584185.179662:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+10:22726:x1871271599232256:12345-0@lo:256:mount.lustre.0 Request processed in 101us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584185.179678:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784584185.179771:0:22726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:22726:1871271599232256:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1784584185.180543:0:22726:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784584185.180606:0:22726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982c00/0xdab2421a42e49353 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4935a expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584185.180617:0:22726:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b418982c00/0xdab2421a42e49353 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4935a expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584185.180626:0:22726:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b405f11000 from 1 10000000:01000000:0.0:1784584185.180629:0:22726:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784584185.180732:0:22726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4332b9600/0xdab2421a42e49361 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584185.180741:0:22726:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b4332b9600/0xdab2421a42e49361 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584185.180751:0:22726:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b4332b9600/0xdab2421a42e49361 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584185.180767:0:22726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:22726:1871271599232384:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784584185.180801:0:22726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584185.180870:0:22726:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a546cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584185.183019:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599232384 00000100:00100000:2.0:1784584185.183030:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599232384 00000100:00100000:2.0:1784584185.183086:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784584185.183096:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+10:22726:x1871271599232384:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784584185.183110:0:22741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584185.183126:0:22741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ea7be00/0xdab2421a42e49368 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e49361 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584185.183151:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ea7be00/0xdab2421a42e49368 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e49361 expref: 11 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584185.183171:0:22741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ea7be00/0xdab2421a42e49368 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e49361 expref: 11 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584185.183181:0:22741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7be00, rc 0) 00000100:00100000:2.0:1784584185.183237:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+11:22726:x1871271599232384:12345-0@lo:101:mount.lustre.0 Request processed in 143us (2435us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584185.183434:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784584185.183593:0:22726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:22726:1871271599232384:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784584185.183624:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b4332b9600/0xdab2421a42e49361 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e49368 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584185.183634:0:22726:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b4332b9600/0xdab2421a42e49361 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e49368 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584185.183727:0:22726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:22726:1871271599232512:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784584185.183757:0:22726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584185.183790:0:22726:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a546cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584185.183884:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599232512 00000100:00100000:2.0:1784584185.183889:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599232512 00000100:00100000:2.0:1784584185.183920:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784584185.183927:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+11:22726:x1871271599232512:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584185.184060:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+11:22726:x1871271599232512:12345-0@lo:501:mount.lustre.0 Request processed in 133us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584185.184067:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784584185.184312:0:22726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:22726:1871271599232512:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784584185.184337:0:22726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:22726:1871271599232640:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784584185.184373:0:22726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584185.184393:0:22726:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a546cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584185.184553:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599232640 00000100:00100000:2.0:1784584185.184564:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599232640 00000100:00100000:2.0:1784584185.184587:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784584185.184593:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+11:22726:x1871271599232640:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784584185.184816:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+11:22726:x1871271599232640:12345-0@lo:503:mount.lustre.0 Request processed in 222us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584185.184822:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784584185.186361:0:22726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:22726:1871271599232640:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784584185.186859:0:22775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437693b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:954867da-9a7c-4a17-b608-74c1de1cda93:22775:1871271599232768:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584185.186914:0:22775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584185.187041:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599232768 00000100:00100000:3.0:1784584185.187047:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599232768 00000100:00100000:3.0:1784584185.187090:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784584185.187098:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+11:22775:x1871271599232768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784584185.187441:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+11:22775:x1871271599232768:12345-0@lo:502:llog_process_th.0 Request processed in 342us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584185.187449:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784584185.187587:0:22775:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b30401e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584185.187605:0:22775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437693b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:954867da-9a7c-4a17-b608-74c1de1cda93:22775:1871271599232768:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784584185.187630:0:22775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584185.187638:0:22775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584185.187711:0:22775:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784584185.187721:0:22775:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98b405f11000 00000020:00000080:2.0:1784584185.187724:0:22775:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784584185.187731:0:22775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584185.187734:0:22775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584185.187735:0:22775:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1784584185.187737:0:22775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584185.187740:0:22775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584185.187741:0:22775:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784584185.187745:0:22775:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98b405f11000 00000020:00000080:2.0:1784584185.187747:0:22775:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784584185.187802:0:22775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584185.187805:0:22775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584185.187807:0:22775:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1784584185.187809:0:22775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584185.187812:0:22775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584185.187814:0:22775:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784584185.187817:0:22775:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98b405f11000 00000020:00000080:2.0:1784584185.187824:0:22775:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784584185.187844:0:22775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584185.187846:0:22775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584185.187847:0:22775:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784584185.187849:0:22775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584185.187852:0:22775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584185.187853:0:22775:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1784584185.187857:0:22775:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98b405f11000 00000020:00000080:2.0:1784584185.187859:0:22775:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784584185.187892:0:22775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437693b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:954867da-9a7c-4a17-b608-74c1de1cda93:22775:1871271599232896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584185.187924:0:22775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584185.189781:0:22775:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b30401e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584185.192420:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599232896 00000100:00100000:3.0:1784584185.192433:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599232896 00000100:00100000:2.0:1784584185.192588:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784584185.192599:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+11:22775:x1871271599232896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584185.192764:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+11:22775:x1871271599232896:12345-0@lo:502:llog_process_th.0 Request processed in 166us (4838us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584185.192772:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784584185.192833:0:22775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437693b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:954867da-9a7c-4a17-b608-74c1de1cda93:22775:1871271599232896:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784584185.192868:0:22775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584185.192876:0:22775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584185.192878:0:22775:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1784584185.192882:0:22775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1784584185.204429:0:22726:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1784584185.204482:0:22726:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784584185.204505:0:22726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4332b9600/0xdab2421a42e49361 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e49368 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584185.204517:0:22726:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b4332b9600/0xdab2421a42e49361 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e49368 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584185.204570:0:22726:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784584185.204573:0:22726:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98b405f11000 10000000:01000000:0.0:1784584185.204576:0:22726:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98b405f11000 10000000:01000000:0.0:1784584185.204579:0:22726:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784584185.204584:0:22726:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98b405f11000 from 1 10000000:01000000:0.0:1784584185.204593:0:22726:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784584185.204627:0:22726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4332b8000/0xdab2421a42e4936f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584185.204636:0:22726:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b4332b8000/0xdab2421a42e4936f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584185.204661:0:22726:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b4332b8000/0xdab2421a42e4936f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584185.204685:0:22726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:22726:1871271599233024:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784584185.204749:0:22726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584185.204783:0:22726:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a5463c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784584185.204808:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599233024 00000100:00100000:0.0:1784584185.204814:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599233024 00000100:00100000:0.0:1784584185.204853:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784584185.204861:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+11:22726:x1871271599233024:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784584185.204875:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584185.204887:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b4332b9a00/0xdab2421a42e49376 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e4936f expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584185.204909:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4332b9a00/0xdab2421a42e49376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e4936f expref: 12 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584185.204919:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b4332b9a00/0xdab2421a42e49376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e4936f expref: 12 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584185.204928:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b9a00, rc 0) 00000100:00100000:0.0:1784584185.204976:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+12:22726:x1871271599233024:12345-0@lo:101:mount.lustre.0 Request processed in 115us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584185.204993:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784584185.205043:0:22726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:22726:1871271599233024:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784584185.205057:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b4332b8000/0xdab2421a42e4936f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e49376 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584185.205065:0:22726:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b4332b8000/0xdab2421a42e4936f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e49376 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584185.205128:0:22726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:22726:1871271599233152:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784584185.205151:0:22726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584185.205601:0:22726:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a5463c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584185.206106:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599233152 00000100:00100000:2.0:1784584185.206113:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599233152 00000100:00100000:2.0:1784584185.206148:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784584185.206155:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+12:22726:x1871271599233152:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584185.206299:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+12:22726:x1871271599233152:12345-0@lo:501:mount.lustre.0 Request processed in 144us (1146us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584185.206316:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784584185.206580:0:22726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:22726:1871271599233152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584185.206615:0:22726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:22726:1871271599233280:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784584185.206668:0:22726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584185.206691:0:22726:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b30401ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1784584185.206704:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599233280 00000100:00100000:2.0:1784584185.206708:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599233280 00000100:00100000:2.0:1784584185.206730:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784584185.206736:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+12:22726:x1871271599233280:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784584185.206808:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+12:22726:x1871271599233280:12345-0@lo:503:mount.lustre.0 Request processed in 72us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584185.206815:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784584185.206855:0:22726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:22726:1871271599233280:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784584185.207376:0:22779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437693b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:954867da-9a7c-4a17-b608-74c1de1cda93:22779:1871271599233408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584185.207413:0:22779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584185.207431:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599233408 00000100:00100000:2.0:1784584185.207435:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599233408 00000100:00100000:2.0:1784584185.207457:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784584185.207463:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+12:22779:x1871271599233408:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584185.207554:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+12:22779:x1871271599233408:12345-0@lo:502:llog_process_th.0 Request processed in 90us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584185.207562:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784584185.207594:0:22779:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b30401e780 going to sleep for 11 seconds 00000100:00100000:2.0:1784584185.207607:0:22779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437693b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:954867da-9a7c-4a17-b608-74c1de1cda93:22779:1871271599233408:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1784584185.209353:0:22779:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1784584185.209370:0:22779:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff98b4071a99c0) 00000020:00000080:2.0:1784584185.209389:0:22779:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1784584185.209553:0:22779:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98b405f11000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1784584185.209558:0:22779:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98b405f11000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1784584185.209560:0:22779:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b405f11000 4 00010000:00080000:2.0:1784584185.209588:0:22779:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b302b0d000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.151@tcp at head 00010000:00010000:2.0:1784584185.220941:0:22779:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1784584185.221053:0:22779:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1784584185.221095:0:22779:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784584185.221109:0:22779:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xdab2421a42e49384 00000100:00080000:2.0:1784584185.221118:0:22779:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784584185.221124:0:22779:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98b302b0d000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784584185.221327:0:22779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b437693b80 x1871271599233536/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784584185.221352:0:22779:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1784584185.221579:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1871271599233536:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784584185.221660:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584185.221850:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599233536 00000100:00100000:2.0:1784584185.221858:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599233536 00000100:00100000:2.0:1784584185.221894:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784584185.221900:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1871271599233536:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784584185.221965:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1871271599233536:12345-0@lo:38:llog_process_th.0 Request processed in 63us (304us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784584185.221972:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784584185.222006:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784584185.222023:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b302b0d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784584185.222027:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784584185.222031:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1871271599233536:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784584185.224991:0:22779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437693b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:954867da-9a7c-4a17-b608-74c1de1cda93:22779:1871271599233664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584185.225067:0:22779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584185.225101:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599233664 00000100:00100000:2.0:1784584185.225108:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599233664 00000100:00100000:2.0:1784584185.225150:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784584185.225158:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+12:22779:x1871271599233664:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584185.225393:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+12:22779:x1871271599233664:12345-0@lo:502:llog_process_th.0 Request processed in 234us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584185.225400:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784584185.225446:0:22779:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cbe9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784584185.225485:0:22779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437693b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:954867da-9a7c-4a17-b608-74c1de1cda93:22779:1871271599233664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584185.225523:0:22779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437693b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:954867da-9a7c-4a17-b608-74c1de1cda93:22779:1871271599233792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584185.225554:0:22779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584185.225575:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599233792 00000100:00100000:2.0:1784584185.225578:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599233792 00000100:00100000:2.0:1784584185.225598:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784584185.225603:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+12:22779:x1871271599233792:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584185.225675:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+12:22779:x1871271599233792:12345-0@lo:502:llog_process_th.0 Request processed in 71us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584185.225682:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784584185.225711:0:22779:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cbe9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784584185.225722:0:22779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437693b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:954867da-9a7c-4a17-b608-74c1de1cda93:22779:1871271599233792:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784584185.225739:0:22779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1784584185.225800:0:22726:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1784584185.225828:0:22726:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784584185.225842:0:22726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b4332b8000/0xdab2421a42e4936f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e49376 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584185.225852:0:22726:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b4332b8000/0xdab2421a42e4936f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e49376 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784584185.225895:0:22726:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784584185.225897:0:22726:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784584185.225899:0:22726:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784584185.225900:0:22726:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784584185.225901:0:22726:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784584185.225902:0:22726:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784584185.225903:0:22726:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784584185.225905:0:22726:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784584185.225907:0:22726:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784584185.225908:0:22726:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784584185.225911:0:22726:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1784584185.225913:0:22726:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784584185.225915:0:22726:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784584185.225916:0:22726:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784584185.225917:0:22726:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784584185.225918:0:22726:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784584185.225919:0:22726:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784584185.225920:0:22726:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784584185.225921:0:22726:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784584185.225922:0:22726:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784584185.225923:0:22726:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784584185.225935:0:22726:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784584185.225943:0:22726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:22726:1871271599233920:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784584185.225971:0:22726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584185.225982:0:22726:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cbe9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784584185.225996:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599233920 00000100:00100000:2.0:1784584185.226000:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599233920 00000100:00100000:2.0:1784584185.226020:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784584185.226027:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+12:22726:x1871271599233920:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784584185.226051:0:22742:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1784584185.226062:0:22742:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1784584185.243768:0:22742:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784584185.243787:0:22742:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1784584185.244255:0:22763:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784584185.244261:0:22763:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784584185.244283:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e4938b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584185.244300:0:22763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b43ea7ac00/0xdab2421a42e4935a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e49353 expref: 12 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584185.244309:0:22763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e4938b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584185.244347:0:22763:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b43ea7ac00/0xdab2421a42e4935a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e49353 expref: 12 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584185.244361:0:22763:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b43ea7ac00/0xdab2421a42e4935a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e49353 expref: 12 pid: 22741 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584185.244374:0:22763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437692a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22763:1871271599234048:0@lo:104: 00000100:00100000:2.0:1784584185.244429:0:22763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584185.244487:0:22763:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cbe9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584185.244532:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599234048 00000100:00100000:3.0:1784584185.244539:0:22730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599234048 00000100:00100000:3.0:1784584185.244589:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784584185.244598:0:22730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437693100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:954867da-9a7c-4a17-b608-74c1de1cda93+3:22763:x1871271599234048:12345-0@lo:104: 00010000:00010000:3.0:1784584185.244610:0:22730:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b418982c00/0xdab2421a42e49353 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e4935a expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584185.251432:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+12:22726:x1871271599233920:12345-0@lo:253:mount.lustre.0 Request processed in 25393us (25449us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584185.251447:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784584185.251563:0:22726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437693b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:22726:1871271599233920:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784584185.251580:0:22726:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1784584185.251583:0:22726:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784584185.251585:0:22726:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784584185.251587:0:22726:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784584185.251588:0:22726:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784584185.251590:0:22726:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784584185.251592:0:22726:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784584185.251593:0:22726:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784584185.251595:0:22726:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784584185.251604:0:22726:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784584185.251606:0:22726:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1784584185.251622:0:22726:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1784584185.261604:0:22730:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784584185.261617:0:22763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437692a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22763:1871271599234048:0@lo:104: 00000100:00100000:3.0:1784584185.261618:0:22730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437693100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:954867da-9a7c-4a17-b608-74c1de1cda93+3:22763:x1871271599234048:12345-0@lo:104: Request processed in 17018us (17185us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584185.261636:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1784584185.261661:0:22763:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e4938b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584185.261776:0:22736:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584185.261785:0:22736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b418982c00/0xdab2421a42e49353 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e4935a expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584185.261794:0:22736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982c00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:1.0:1784584185.261798:0:22736:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b418982c00/0xdab2421a42e49353 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e4935a expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584185.261808:0:22736:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b418982c00/0xdab2421a42e49353 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e4935a expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784584185.261815:0:22736:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b418982c00/0xdab2421a42e49353 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e4935a expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584185.261821:0:22736:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784584185.261867:0:22736:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b418982c00/0xdab2421a42e49353 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4935a expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584185.261874:0:22736:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784584185.261906:0:22736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b418982c00/0xdab2421a42e49353 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4935a expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584185.261913:0:22736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b418982c00/0xdab2421a42e49353 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4935a expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584185.261930:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584185.261932:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584185.261935:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584185.261979:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:954867da-9a7c-4a17-b608-74c1de1cda93:3640:1871271599234176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584185.262033:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584185.262259:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599234176 00000100:00100000:1.0:1784584185.262275:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599234176 00010000:00010000:1.0:1784584185.262302:0:22732:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b43ea7ac00/0xdab2421a42e4935a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e49353 expref: 12 pid: 22741 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584185.262337:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784584185.262345:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:954867da-9a7c-4a17-b608-74c1de1cda93+12:3640:x1871271599234176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784584185.262357:0:22732:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584185.262362:0:22732:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b43ea7ac00/0xdab2421a42e4935a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e49353 expref: 12 pid: 22741 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584185.262374:0:22732:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b43ea7ac00/0xdab2421a42e4935a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e49353 expref: 12 pid: 22741 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584185.262387:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b43ea7ac00/0xdab2421a42e4935a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e49353 expref: 12 pid: 22741 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584185.262401:0:22732:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e4938b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584185.262410:0:22732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e4938b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784584185.262424:0:22732:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.018163401s 00010000:00010000:1.0:1784584185.262428:0:22732:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e4938b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584185.262435:0:22732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e4938b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584185.262444:0:22732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e4938b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584185.262667:0:22732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e4938b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584185.262673:0:22732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7a600 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:1.0:1784584185.262678:0:22732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e4938b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584185.262686:0:22732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e4938b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584185.262707:0:22732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e4938b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584185.262718:0:22732:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584185.262760:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:954867da-9a7c-4a17-b608-74c1de1cda93+11:3640:x1871271599234176:12345-0@lo:103:ldlm_bl.0 Request processed in 415us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584185.262768:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784584185.262802:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:954867da-9a7c-4a17-b608-74c1de1cda93:3640:1871271599234176:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784584185.263074:0:22763:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e4938b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584185.263084:0:22763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e4938b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584185.263091:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e4938b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1784584185.270417:0:22726:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967530 00000040:01000000:0.0:1784584185.270987:0:22726:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1784584185.271088:0:22787:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967530 00000020:00080000:2.0:1784584185.271092:0:22787:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000040:01000000:2.0:1784584185.271512:0:22788:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784584185.271793:0:22726:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1784584185.271910:0:22788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:0.0:1784584185.272583:0:22789:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff98b43c8ece00 x1871271599234304/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584185.272595:0:22789:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039ef600 going to sleep for 0 seconds 00000040:01000000:1.0:1784584185.272824:0:22726:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1784584185.272860:0:22726:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1784584185.273862:0:22726:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1784584185.273874:0:22726:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1784584185.273926:0:22726:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784584185.276302:0:22788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1784584185.276397:0:22788:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1784584185.278373:0:22726:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1784584185.278984:0:22726:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1784584185.279539:0:22726:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1784584185.280418:0:22726:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:1.0:1784584185.280971:0:22726:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:1.0:1784584185.284563:0:22726:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1784584185.287174:0:22726:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1784584185.287218:0:22726:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbb9d4185b988 00100000:10000000:1.0:1784584185.287227:0:22726:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1784584185.289628:0:22726:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784584185.289660:0:22726:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.151@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784584185.289692:0:22726:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1784584185.289717:0:22726:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1784584185.291009:0:22726:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784584185.291447:0:22726:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784584185.838583:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584186.285698:0:22789:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039ef600 going to sleep for 0 seconds 00000040:00080000:2.0:1784584186.287205:0:22782:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1784584186.287212:0:22782:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784584186.288673:0:22782:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1784584186.288686:0:22782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:2.0:1784584186.798540:0:22744:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784584186.798547:0:22744:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98b405f11000 from 11 10000000:01000000:2.0:1784584186.798552:0:22744:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784584186.798594:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7aa00/0xdab2421a42e49392 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584186.798605:0:22744:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b43ea7aa00/0xdab2421a42e49392 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584186.798616:0:22744:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b43ea7aa00/0xdab2421a42e49392 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584186.798656:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437692a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599234432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784584186.798723:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584186.798764:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a0f7480 going to sleep for 11 seconds 00000100:00100000:3.0:1784584186.798829:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599234432 00000100:00100000:3.0:1784584186.798836:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599234432 00000100:00100000:3.0:1784584186.798906:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784584186.798917:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+11:22744:x1871271599234432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784584186.798930:0:22741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584186.798942:0:22741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b418983c00/0xdab2421a42e49399 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e49392 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584186.798971:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b418983c00/0xdab2421a42e49399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e49392 expref: 12 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584186.798991:0:22741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b418983c00/0xdab2421a42e49399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e49392 expref: 12 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584186.798999:0:22741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b418983c00, rc 0) 00000100:00100000:3.0:1784584186.799044:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+12:22744:x1871271599234432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584186.799051:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784584186.799416:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437692a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599234432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784584186.799432:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b43ea7aa00/0xdab2421a42e49392 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e49399 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584186.799441:0:22744:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7aa00/0xdab2421a42e49392 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e49399 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584186.799521:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599234560:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784584186.799554:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584186.799577:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7080c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584186.799700:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599234560 00000100:00100000:2.0:1784584186.799704:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599234560 00000100:00100000:2.0:1784584186.799734:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784584186.799742:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+12:22744:x1871271599234560:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784584186.799756:0:22742:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784584186.799776:0:22742:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784584186.799778:0:22742:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1784584186.799854:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+12:22744:x1871271599234560:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 113us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584186.799862:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784584186.799992:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599234560:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784584186.800032:0:22744:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784584186.800038:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7aa00/0xdab2421a42e49392 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e49399 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584186.800047:0:22744:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b43ea7aa00/0xdab2421a42e49392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e49399 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584186.871763:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784584187.310150:0:22782:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1784584187.310160:0:22782:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784584187.310300:0:22782:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1784584187.310351:0:22782:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1784584187.310791:0:22789:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039ef600 going to sleep for 0 seconds 00000040:00080000:0.0:1784584187.310922:0:22782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:3.0:1784584187.885770:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584188.333663:0:22789:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039ef600 going to sleep for 0 seconds 00010000:00010000:0.0:1784584188.909572:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584189.358584:0:22789:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039ef600 going to sleep for 0 seconds 00000001:02000400:0.0:1784584189.551730:0:23031:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784584189.934661:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784584190.222168:0:23084:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784584190.222353:0:23084:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1784584190.381816:0:22789:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039ef600 going to sleep for 0 seconds 00000100:00100000:2.0:1784584190.638221:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:954867da-9a7c-4a17-b608-74c1de1cda93:3641:1871271599234688:0@lo:400:kworker.0 00000100:00100000:2.0:1784584190.638288:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784584190.638412:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784584190.638416:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1784584190.638419:0:38:0:(import.c:65:import_set_state_nolock()) ffff98b3040b2000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784584190.638424:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 628 00000100:00080000:3.0:1784584190.638430:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784584190.638435:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98b3040b2000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:3.0:1784584190.638457:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b302b46300 x1871271599234816/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784584190.638492:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784584190.638495:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784584190.638498:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784584190.638501:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784584190.638514:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784584190.638517:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784584190.638519:0:38:0:(import.c:65:import_set_state_nolock()) ffff98b302b0d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784584190.638524:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98b302b0d000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:3.0:1784584190.638536:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b302b45180 x1871271599234944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784584190.638625:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599234688 00000100:00100000:0.0:1784584190.638632:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599234688 00000100:00100000:0.0:1784584190.638712:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784584190.638721:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+12:3641:x1871271599234688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584190.639317:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+12:3641:x1871271599234688:12345-0@lo:400:kworker.0 Request processed in 595us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584190.639326:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784584190.639366:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599234816:0@lo:38:kworker.0 00000100:00100000:0.0:1784584190.639411:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584190.639437:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1871271599234944:0@lo:38:kworker.0 00000100:00100000:0.0:1784584190.639459:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584190.639632:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599234816 00000100:00100000:3.0:1784584190.639638:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599234816 00000100:00100000:3.0:1784584190.639665:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784584190.639671:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1871271599234816:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784584190.639686:0:22753:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784584190.639719:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1871271599234816:12345-0@lo:38:kworker.0 Request processed in 47us (307us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784584190.639726:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784584190.639955:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599234944 00000100:00100000:1.0:1784584190.639960:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599234944 00000100:00100000:1.0:1784584190.639986:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784584190.639996:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1871271599234944:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1784584190.640012:0:22749:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 633 last 0 00000020:00000080:1.0:1784584190.640046:0:22749:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xdab2421a42e493a0 00000004:00100000:1.0:1784584190.640059:0:22749:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784584190.640177:0:22749:0:(import.c:65:import_set_state_nolock()) ffff98b302460000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784584190.640214:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1871271599234944:12345-0@lo:38:kworker.0 Request processed in 217us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584190.640220:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1784584190.640417:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b3040b2000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784584190.640422:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784584190.640425:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599234816:0@lo:38:kworker.0 00010000:00080000:0.0:1784584190.640438:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98b302b45180 x1871271599234944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784584200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784584190.640450:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1784584190.640457:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1784584190.640461:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784584190.640463:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b302b0d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784584190.640738:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:954867da-9a7c-4a17-b608-74c1de1cda93:3641:1871271599234688:0@lo:400:kworker.0 00000100:00100000:0.0:1784584190.643043:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1871271599234944:0@lo:38:kworker.0 00010000:00010000:0.0:1784584190.958584:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784584191.090207:0:23134:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784584191.090383:0:23134:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1784584191.405649:0:22789:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039ef600 going to sleep for 0 seconds 00010000:00010000:3.0:1784584191.985591:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584192.430348:0:22789:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039ef600 going to sleep for 0 seconds 00010000:00010000:0.0:1784584193.005682:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584193.457181:0:22789:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039ef600 going to sleep for 0 seconds 00010000:00010000:3.0:1784584194.030105:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584194.479523:0:22789:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039ef600 going to sleep for 0 seconds 00010000:00010000:0.0:1784584195.053557:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584195.502561:0:22789:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039ef600 going to sleep for 0 seconds 00000100:00100000:2.0:1784584195.757539:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784584185/real 1784584185] req@ffff98b437691500 x1871271599231872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584195 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584195.757569:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98b437691500 x1871271599231872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584195 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584195.757589:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784584185/real 1784584185] req@ffff98b437690e00 x1871271599231744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584195 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584195.757602:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98b437690e00 x1871271599231744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584195 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784584195.757619:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b3041fd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784584195.757644:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1784584195.757649:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437691500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599231872:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1784584195.757655:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b416bde800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784584195.757660:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1784584195.757671:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599231744:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1784584195.757781:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1784584195.757786:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1784584195.757789:0:36:0:(import.c:65:import_set_state_nolock()) ffff98b3040b2000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784584195.757793:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 633 00000100:00080000:0.0:1784584195.757798:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1784584195.757803:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98b3040b2000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:0.0:1784584195.757821:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b43c8edf80 x1871271599235200/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784584195.757832:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784584195.757834:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1784584195.757836:0:36:0:(import.c:65:import_set_state_nolock()) ffff98b416bde800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784584195.757839:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 628 00000100:00080000:0.0:1784584195.757841:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784584195.757844:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98b416bde800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:0.0:1784584195.757853:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b43c8ef100 x1871271599235328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784584195.757860:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784584195.757863:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1784584195.757865:0:36:0:(import.c:65:import_set_state_nolock()) ffff98b3041fd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784584195.757873:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 628 00000100:00080000:0.0:1784584195.757876:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784584195.757879:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98b3041fd000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:0.0:1784584195.757889:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b43c8ee680 x1871271599235456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784584195.757997:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:954867da-9a7c-4a17-b608-74c1de1cda93:3642:1871271599235072:0@lo:400:kworker.0 00000100:00100000:2.0:1784584195.758056:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584195.758137:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599235072 00000100:00100000:2.0:1784584195.758143:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599235072 00000100:00100000:2.0:1784584195.758185:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784584195.758193:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+12:3642:x1871271599235072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584195.758238:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+12:3642:x1871271599235072:12345-0@lo:400:kworker.0 Request processed in 45us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584195.758245:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784584195.758298:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:954867da-9a7c-4a17-b608-74c1de1cda93:3642:1871271599235072:0@lo:400:kworker.0 00000100:00100000:2.0:1784584195.758316:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599235200:0@lo:38:kworker.0 00000100:00100000:2.0:1784584195.758614:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584195.758635:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599235328:0@lo:8:kworker.0 00000400:00000100:2.0:1784584195.758657:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871271599235328 offset 0 length 520: 4 00000100:00100000:2.0:1784584195.758675:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599235456:0@lo:8:kworker.0 00000400:00000100:2.0:1784584195.758693:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871271599235456 offset 0 length 520: 4 00000100:00100000:2.0:1784584195.758718:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599235200 00000100:00100000:2.0:1784584195.758722:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599235200 00000100:00100000:2.0:1784584195.758741:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784584195.758746:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1871271599235200:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784584195.758760:0:22753:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784584195.758791:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1871271599235200:12345-0@lo:38:kworker.0 Request processed in 43us (177us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784584195.758808:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1784584195.758837:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b3040b2000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784584195.758841:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784584195.758844:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599235200:0@lo:38:kworker.0 00000100:00100000:0.0:1784584195.759800:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599235584:0@lo:400:kworker.0 00000100:00100000:0.0:1784584195.759845:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584195.760520:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599235584 00000100:00100000:2.0:1784584195.760529:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599235584 00000100:00100000:2.0:1784584195.760570:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784584195.760588:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599235584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584195.760648:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599235584:12345-0@lo:400:kworker.0 Request processed in 62us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584195.760655:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1784584195.760689:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98b43c8ec700 x1871271599235584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584195.760701:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599235584:0@lo:400:kworker.0 00010000:00010000:3.0:1784584196.078524:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584196.526553:0:22789:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039ef600 going to sleep for 0 seconds 00010000:00010000:0.0:1784584197.104747:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784584197.350708:0:23480:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784584197.350712:0:23480:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1784584197.350713:0:23480:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1784584197.350826:0:23480:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff98b4049d6000 00000020:01000004:3.0:1784584197.350852:0:23480:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1784584197.350864:0:23480:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1784584197.350878:0:23480:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff98b42e9319c0) 00000020:00000080:3.0:1784584197.350893:0:23480:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1784584197.412212:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1784584197.412510:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1784584197.413452:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1784584197.415978:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1784584197.416317:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1784584197.416790:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1784584197.417097:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1784584197.417352:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1784584197.417649:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1784584197.418007:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1784584197.418244:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1784584197.418529:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1784584197.418764:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1784584197.419186:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1784584197.419465:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1784584197.428514:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1784584197.429453:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1784584197.430039:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1784584197.430501:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1784584197.430787:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1784584197.431170:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1784584197.431450:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1784584197.431717:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1784584197.432139:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1784584197.433512:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1784584197.434064:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1784584197.434303:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1784584197.434823:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1784584197.441247:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1784584197.442064:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1784584197.442300:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1784584197.443275:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1784584197.444440:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1784584197.444722:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1784584197.458536:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1784584197.459366:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1784584197.459712:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1784584197.459964:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1784584197.460159:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1784584197.460411:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1784584197.460989:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1784584197.461528:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1784584197.462439:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1784584197.465525:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1784584197.466015:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1784584197.466251:0:23480:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:2.0:1784584197.468095:0:23480:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1784584197.468312:0:23480:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1784584197.468323:0:23480:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784584197.468493:0:23480:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdab2421a42e493ae 00000020:01000004:2.0:1784584197.468502:0:23480:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1784584197.468527:0:23480:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.151@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784584197.468531:0:23480:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784584197.468537:0:23480:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1784584197.468576:0:23480:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1784584197.468580:0:23480:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.151@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1784584197.484179:0:23480:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.151@tcp ctxt 0 is initialized 00000020:01000004:1.0:1784584197.484222:0:23480:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.151@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1784584197.484226:0:23480:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1784584197.484228:0:23480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1784584197.484229:0:23480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784584197.484231:0:23480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784584197.484232:0:23480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784584197.484234:0:23480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784584197.484235:0:23480:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784584197.484236:0:23480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784584197.484237:0:23480:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784584197.484241:0:23480:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1784584197.484243:0:23480:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784584197.484244:0:23480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1784584197.484245:0:23480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784584197.484246:0:23480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784584197.484247:0:23480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784584197.484248:0:23480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784584197.484249:0:23480:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784584197.484250:0:23480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784584197.484251:0:23480:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784584197.484277:0:23480:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1784584197.484298:0:23480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599235712:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784584197.484378:0:23480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584197.484418:0:23480:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7c3300 going to sleep for 11 seconds 00000100:00100000:0.0:1784584197.484678:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599235712 00000100:00100000:0.0:1784584197.484686:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599235712 00000100:00100000:0.0:1784584197.484739:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784584197.484747:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+12:23480:x1871271599235712:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784584197.484783:0:22740:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1784584197.484786:0:22740:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1784584197.484793:0:22740:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1784584197.485377:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+12:23480:x1871271599235712:12345-0@lo:253:mount.lustre.0 Request processed in 629us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584197.485385:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784584197.485507:0:23480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599235712:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784584197.485518:0:23480:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1784584197.485520:0:23480:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784584197.485522:0:23480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1784584197.485523:0:23480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784584197.485524:0:23480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784584197.485525:0:23480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784584197.485526:0:23480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784584197.485527:0:23480:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784584197.485528:0:23480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784584197.485529:0:23480:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1784584197.485546:0:23480:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98b4049d6000 from lustre-MDT0001 10000000:01000000:1.0:1784584197.485586:0:23480:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1784584197.485589:0:23480:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1784584197.485595:0:23480:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98b302bf0000 local copy 00010000:00010000:1.0:1784584197.485603:0:23480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418983600/0xdab2421a42e492a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e492ab expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584197.485687:0:23480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599235840:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584197.485714:0:23480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584197.485736:0:23480:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7c3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784584197.485808:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599235840 00000100:00100000:2.0:1784584197.485814:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599235840 00000100:00100000:2.0:1784584197.486099:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784584197.486108:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+12:23480:x1871271599235840:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584197.486188:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+12:23480:x1871271599235840:12345-0@lo:501:mount.lustre.0 Request processed in 82us (473us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784584197.486195:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784584197.486249:0:23480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599235840:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1784584197.486261:0:23480:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1784584197.486278:0:23480:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1784584197.486285:0:23480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418983600/0xdab2421a42e492a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e492ab expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584197.486294:0:23480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b418983600/0xdab2421a42e492a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e492ab expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584197.486322:0:23480:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98b4049d6000 10000000:01000000:1.0:1784584197.486327:0:23480:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784584197.486331:0:23480:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff98b302bf0000 10000000:01000000:1.0:1784584197.486334:0:23480:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1784584197.486337:0:23480:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff98b302bf0000 from 1 10000000:01000000:1.0:1784584197.486352:0:23480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784584197.486380:0:23480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e493b5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584197.486388:0:23480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e493b5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584197.486396:0:23480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e493b5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584197.486409:0:23480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599235968:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784584197.486434:0:23480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584197.490461:0:23480:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7c3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784584197.490674:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599235968 00000100:00100000:3.0:1784584197.490683:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599235968 00000100:00100000:3.0:1784584197.490732:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784584197.490741:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+12:23480:x1871271599235968:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784584197.490756:0:22741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584197.490776:0:22741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b418983200/0xdab2421a42e493bc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e493b5 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.490804:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b418983200/0xdab2421a42e493bc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e493b5 expref: 13 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.490816:0:22741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b418983200/0xdab2421a42e493bc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e493b5 expref: 13 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.490826:0:22741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b418983200, rc 0) 00000100:00100000:3.0:1784584197.490898:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+13:23480:x1871271599235968:12345-0@lo:101:mount.lustre.0 Request processed in 157us (4463us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584197.490925:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784584197.491137:0:23480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599235968:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784584197.491154:0:23480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e493b5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e493bc expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584197.491163:0:23480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e493b5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e493bc expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584197.491184:0:23480:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784584197.491202:0:23480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e493b5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e493bc expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584197.491222:0:23480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b303b1ce00/0xdab2421a42e493b5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e493bc expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584197.491233:0:23480:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98b4049d6000 10000000:01000000:1.0:1784584197.491238:0:23480:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1784584197.491242:0:23480:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff98b4049d6000 from 1 10000000:01000000:1.0:1784584197.491245:0:23480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1784584197.491268:0:23480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1ca00/0xdab2421a42e493c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584197.491276:0:23480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b303b1ca00/0xdab2421a42e493c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584197.491284:0:23480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b303b1ca00/0xdab2421a42e493c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584197.491301:0:23480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599236096:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784584197.491434:0:23480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584197.491463:0:23480:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7c3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784584197.491526:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599236096 00000100:00100000:3.0:1784584197.491530:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599236096 00000100:00100000:3.0:1784584197.491552:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784584197.491558:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+13:23480:x1871271599236096:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784584197.491577:0:22741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584197.491586:0:22741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b418983000/0xdab2421a42e493ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e493c3 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.491600:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b418983000/0xdab2421a42e493ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e493c3 expref: 14 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.491609:0:22741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b418983000/0xdab2421a42e493ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e493c3 expref: 14 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.491615:0:22741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b418983000, rc 0) 00000100:00100000:3.0:1784584197.491651:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+14:23480:x1871271599236096:12345-0@lo:101:mount.lustre.0 Request processed in 93us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584197.491657:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784584197.491826:0:23480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599236096:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784584197.491837:0:23480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b303b1ca00/0xdab2421a42e493c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e493ca expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584197.491860:0:23480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b303b1ca00/0xdab2421a42e493c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e493ca expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584197.491872:0:23480:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1784584197.492004:0:23480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1ca00/0xdab2421a42e493c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e493ca expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584197.492020:0:23480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b303b1ca00/0xdab2421a42e493c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e493ca expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584197.492026:0:23480:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1784584197.492029:0:23480:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784584197.492034:0:23480:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98b4049d6000 10000000:01000000:1.0:1784584197.492037:0:23480:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1784584197.492040:0:23480:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1784584197.492043:0:23480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1784584197.492058:0:23480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e493d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584197.492065:0:23480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e493d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584197.492073:0:23480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e493d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584197.492085:0:23480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599236224:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784584197.492110:0:23480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584197.492129:0:23480:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7c3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784584197.492288:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599236224 00000100:00100000:2.0:1784584197.492293:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599236224 00000100:00100000:2.0:1784584197.492321:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784584197.492328:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+14:23480:x1871271599236224:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784584197.492413:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584197.492423:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ea7bc00/0xdab2421a42e493d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e493d1 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584197.492439:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ea7bc00/0xdab2421a42e493d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e493d1 expref: 15 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584197.492447:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ea7bc00/0xdab2421a42e493d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e493d1 expref: 15 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584197.492454:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7bc00, rc 0) 00000100:00100000:2.0:1784584197.492512:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+15:23480:x1871271599236224:12345-0@lo:101:mount.lustre.0 Request processed in 184us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584197.492519:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784584197.492604:0:23480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599236224:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784584197.492616:0:23480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e493d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e493d8 expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584197.492625:0:23480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e493d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e493d8 expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784584197.494232:0:23480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:1.0:1784584197.495213:0:23480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784584197.503198:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1784584197.503259:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:1.0:1784584197.503278:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:1.0:1784584197.503293:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:1.0:1784584197.503308:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:1.0:1784584197.503321:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:1.0:1784584197.503333:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:1.0:1784584197.507901:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:1.0:1784584197.507991:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:1.0:1784584197.508008:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:1.0:1784584197.508021:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:1.0:1784584197.508033:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:1.0:1784584197.508044:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:1.0:1784584197.508056:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:1.0:1784584197.508070:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:1.0:1784584197.508085:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:1.0:1784584197.508097:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:1.0:1784584197.508115:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:1.0:1784584197.508136:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:1.0:1784584197.508150:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:1.0:1784584197.508162:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:1.0:1784584197.508175:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:1.0:1784584197.508186:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:1.0:1784584197.508198:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:1.0:1784584197.508212:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:1.0:1784584197.508223:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:1.0:1784584197.508236:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:1.0:1784584197.508249:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:1.0:1784584197.508261:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:1.0:1784584197.508292:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:1.0:1784584197.508306:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:1.0:1784584197.508321:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:1.0:1784584197.508333:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:1.0:1784584197.508637:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:1.0:1784584197.508652:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:1.0:1784584197.508666:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:1.0:1784584197.508676:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:1.0:1784584197.508688:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:1.0:1784584197.508701:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:1.0:1784584197.508713:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:1.0:1784584197.508727:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:1.0:1784584197.508741:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:1.0:1784584197.508755:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:1.0:1784584197.508767:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:1.0:1784584197.508799:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:1.0:1784584197.508805:0:23480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:1.0:1784584197.509255:0:23480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599236352:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584197.509323:0:23480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584197.509494:0:23480:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7c3780 going to sleep for 11 seconds 00000100:00100000:2.0:1784584197.510694:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599236352 00000100:00100000:2.0:1784584197.510707:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599236352 00000100:00100000:2.0:1784584197.510757:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784584197.510767:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+15:23480:x1871271599236352:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584197.510963:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+15:23480:x1871271599236352:12345-0@lo:501:mount.lustre.0 Request processed in 197us (1639us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584197.510971:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784584197.511101:0:23480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599236352:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584197.511143:0:23480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599236480:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784584197.511190:0:23480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584197.511221:0:23480:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7c3780 going to sleep for 11 seconds 00000100:00100000:0.0:1784584197.511270:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599236480 00000100:00100000:0.0:1784584197.511275:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599236480 00000100:00100000:0.0:1784584197.511305:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784584197.511312:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+15:23480:x1871271599236480:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784584197.512329:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+15:23480:x1871271599236480:12345-0@lo:503:mount.lustre.0 Request processed in 1013us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584197.512432:0:23480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599236480:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784584197.512920:0:23480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784584197.513001:0:23480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599236608:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784584197.513051:0:23480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584197.513084:0:23480:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7c3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784584197.513503:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599236608 00000100:00100000:3.0:1784584197.513509:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599236608 00000100:00100000:3.0:1784584197.513543:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784584197.513551:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+16:23480:x1871271599236608:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784584197.513916:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784584197.515087:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+15:23480:x1871271599236608:12345-0@lo:502:mount.lustre.0 Request processed in 1532us (2032us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584197.515099:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784584197.515199:0:23480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599236608:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784584197.515441:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1784584197.515531:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:2.0:1784584197.515550:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:2.0:1784584197.515581:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:2.0:1784584197.515595:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:2.0:1784584197.515609:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:2.0:1784584197.515633:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:2.0:1784584197.515645:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:2.0:1784584197.515656:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:2.0:1784584197.515670:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:2.0:1784584197.515680:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:2.0:1784584197.515691:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:2.0:1784584197.515703:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:2.0:1784584197.515717:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:2.0:1784584197.515729:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:2.0:1784584197.515743:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:2.0:1784584197.515756:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:2.0:1784584197.515771:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:2.0:1784584197.515785:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:2.0:1784584197.515797:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:2.0:1784584197.515811:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:2.0:1784584197.515822:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:2.0:1784584197.515833:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:2.0:1784584197.515845:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:2.0:1784584197.515856:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:2.0:1784584197.515868:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:2.0:1784584197.515879:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:2.0:1784584197.515891:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:2.0:1784584197.515903:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:2.0:1784584197.515933:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:2.0:1784584197.515956:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:2.0:1784584197.515977:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:2.0:1784584197.515997:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:2.0:1784584197.516016:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:2.0:1784584197.516037:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:2.0:1784584197.516057:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:2.0:1784584197.516077:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:2.0:1784584197.516096:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:2.0:1784584197.516114:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:2.0:1784584197.516152:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:2.0:1784584197.516172:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:2.0:1784584197.516192:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:2.0:1784584197.516211:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:2.0:1784584197.516228:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:2.0:1784584197.516275:0:23480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437691500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599236736:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784584197.516361:0:23480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584197.516389:0:23480:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cba1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784584197.516601:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599236736 00000100:00100000:0.0:1784584197.516608:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599236736 00000100:00100000:0.0:1784584197.516652:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784584197.516660:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+15:23480:x1871271599236736:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784584197.516769:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+15:23480:x1871271599236736:12345-0@lo:502:mount.lustre.0 Request processed in 110us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584197.516777:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784584197.517917:0:23480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437691500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599236736:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784584197.518008:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:3.0:1784584197.518021:0:23480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1784584197.520104:0:23484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584197.520118:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584197.520120:0:23484:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1784584197.520127:0:23484:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1784584197.520129:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784584197.520144:0:23484:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff98b4049d99c0) 00000020:00000080:0.0:1784584197.520164:0:23484:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1784584197.520169:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1784584197.520261:0:23484:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:0.0:1784584197.520272:0:23484:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdab2421a42e493e6 00000020:00000080:0.0:1784584197.520439:0:23484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1784584197.520442:0:23484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584197.520444:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584197.520445:0:23484:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1784584197.520447:0:23484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584197.520449:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584197.520450:0:23484:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1784584197.520452:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784584197.520457:0:23484:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff98b4049d8000) 00000020:00000080:0.0:1784584197.520489:0:23484:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1784584197.520493:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1784584197.520494:0:23484:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1784584197.520496:0:23484:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1784584197.520499:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784584197.520544:0:23484:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98b4049d6000 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1784584197.520553:0:23484:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff98b4049db380) 00000020:00000080:0.0:1784584197.520559:0:23484:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1784584197.520629:0:23484:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1784584197.520635:0:23484:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdab2421a42e493fb 00000020:00000080:0.0:1784584197.520723:0:23484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1784584197.520730:0:23484:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1784584197.520735:0:23484:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xdab2421a42e49402 00080000:01000000:0.0:1784584197.520740:0:23484:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:0.0:1784584197.520743:0:23484:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdab2421a42e49409 00000040:00080000:2.0:1784584197.551489:0:22782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1784584197.551773:0:22789:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039ef600 going to sleep for 0 seconds 00010000:00010000:3.0:1784584197.615881:0:23484:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1784584197.616489:0:23484:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:3.0:1784584197.616753:0:23484:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1784584197.620772:0:23484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1784584197.620786:0:23484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784584197.621170:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584197.621174:0:23484:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1784584197.621182:0:23484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784584197.621189:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584197.621191:0:23484:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1784584197.621195:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784584197.621200:0:23484:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.151@tcp to nid 0x20000c0a8cb97 (192.168.203.151@tcp) 00000020:00000080:3.0:1784584197.621229:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784584197.621246:0:23484:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff98b42e934d40) 00000020:00000080:3.0:1784584197.621268:0:23484:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1784584197.621274:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784584197.621743:0:23484:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1784584197.621753:0:23484:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:3.0:1784584197.621762:0:23484:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdab2421a42e49417 00010000:00080000:3.0:1784584197.621809:0:23484:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b41e609000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.151@tcp at head 00010000:00010000:3.0:1784584197.626238:0:23484:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1784584197.628457:0:23484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1784584197.628509:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1784584197.628568:0:23484:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1784584197.628596:0:23484:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdab2421a42e4941e 00000100:00080000:2.0:1784584197.628606:0:23484:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784584197.628611:0:23484:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98b41e609000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784584197.628646:0:23484:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b437692d80 x1871271599236864/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784584197.628674:0:23484:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784584197.628703:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1784584197.628708:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1784584197.628711:0:38:0:(import.c:65:import_set_state_nolock()) ffff98b3040b2000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784584197.628715:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 638 00000100:00080000:2.0:1784584197.628719:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784584197.628724:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98b3040b2000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784584197.628739:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b437690700 x1871271599236992/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784584197.628761:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584197.628764:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784584197.628767:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584197.628770:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1784584197.628773:0:23484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584197.628781:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584197.628783:0:23484:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1784584197.628787:0:23484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784584197.628790:0:23484:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1784584197.628791:0:23484:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784584197.628793:0:23484:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784584197.628801:0:23484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784584197.628804:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584197.628806:0:23484:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784584197.628810:0:23484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584197.628814:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584197.628816:0:23484:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1784584197.628821:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1784584197.628824:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599237120:0@lo:400:kworker.0 00000004:01000000:0.0:1784584197.628864:0:23484:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1784584197.628884:0:23484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584197.628889:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584197.628891:0:23484:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1784584197.628894:0:23484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784584197.628896:0:23484:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1784584197.628897:0:23484:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784584197.628901:0:23484:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784584197.628903:0:23484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784584197.628906:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584197.628907:0:23484:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784584197.628909:0:23484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784584197.628913:0:23484:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1784584197.628916:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584197.628918:0:23484:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1784584197.628921:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784584197.628925:0:23484:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.151@tcp to nid 0x20000c0a8cb97 (192.168.203.151@tcp) 00000020:01000000:0.0:1784584197.628945:0:23484:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1784584197.628948:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784584197.628962:0:23484:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff98b30247cd40) 00000020:00000080:0.0:1784584197.628976:0:23484:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1784584197.628981:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:3.0:1784584197.629167:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599236864:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784584197.629200:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584197.629233:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599236992:0@lo:38:kworker.0 00000100:00100000:3.0:1784584197.629264:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584197.629604:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584197.629689:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599236864 00000100:00100000:2.0:1784584197.629696:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599236864 00000004:00080000:0.0:1784584197.629706:0:23484:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1784584197.629713:0:23484:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000100:00100000:2.0:1784584197.629717:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599236992 00000100:00100000:2.0:1784584197.629721:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599236992 00000020:00000080:0.0:1784584197.629722:0:23484:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdab2421a42e4942c 00000100:00100000:2.0:1784584197.629735:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784584197.629742:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1871271599236864:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1784584197.629763:0:23484:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b43e817000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.151@tcp at head 00010000:00080000:2.0:1784584197.629766:0:22753:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 640 last 0 00000020:00000080:2.0:1784584197.629817:0:22753:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdab2421a42e49433 00000004:00100000:2.0:1784584197.629833:0:22753:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1784584197.629839:0:22753:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00010000:00010000:0.0:1784584197.629989:0:23484:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:3.0:1784584197.630435:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599237120 00000100:00100000:3.0:1784584197.630440:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599237120 00000100:00100000:3.0:1784584197.630608:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784584197.630617:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599237120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584197.630694:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599237120:12345-0@lo:400:kworker.0 Request processed in 78us (1804us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584197.630701:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784584197.630765:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98b437692680 x1871271599237120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584197.630790:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599237120:0@lo:400:kworker.0 00000040:01000000:3.0:1784584197.632713:0:23484:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1784584197.635016:0:23484:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1784584197.635260:0:22753:0:(import.c:65:import_set_state_nolock()) ffff98b3041f9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784584197.635348:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1871271599236864:12345-0@lo:38:llog_process_th.0 Request processed in 5603us (6144us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584197.635363:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784584197.635395:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784584197.635402:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1871271599236992:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1784584197.635441:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1871271599236992:12345-0@lo:38:kworker.0 Request processed in 39us (6176us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784584197.635447:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784584197.636260:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784584197.636273:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1784584197.636281:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1784584197.636286:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784584197.636289:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b41e609000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784584197.636302:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599236864:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784584197.636314:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784584197.636318:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b3040b2000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784584197.636322:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1784584197.636324:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599236992:0@lo:38:kworker.0 00000040:00080000:0.0:1784584197.637781:0:23484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784584197.638597:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1784584197.638740:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:3.0:1784584197.639712:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599237248:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784584197.639777:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584197.640138:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599237248 00000100:00100000:2.0:1784584197.640147:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599237248 00000100:00100000:2.0:1784584197.640197:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784584197.640206:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1871271599237248:12345-0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1784584197.642179:0:23489:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1784584197.642184:0:23489:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000004:00000024:2.0:1784584197.642310:0:22752:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1784584197.642403:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1871271599237248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2195us (2622us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584197.642414:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784584197.642730:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599237248:0@lo:41:osp-pre-0-1.0 00000020:00000080:0.0:1784584197.643962:0:23484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784584197.643974:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784584197.644015:0:23484:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1784584197.644037:0:23484:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdab2421a42e4943a 00000100:00080000:0.0:1784584197.644047:0:23484:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784584197.644052:0:23484:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff98b43e817000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:0.0:1784584197.644086:0:23484:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b43c8ef800 x1871271599237376/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784584197.644114:0:23484:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1784584197.644220:0:23484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584197.644224:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584197.644236:0:23484:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1784584197.644240:0:23484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784584197.644242:0:23484:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1784584197.644244:0:23484:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784584197.644246:0:23484:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784584197.644247:0:23484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784584197.644250:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584197.644251:0:23484:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784584197.644253:0:23484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784584197.644258:0:23484:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1784584197.644261:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584197.644262:0:23484:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1784584197.644273:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784584197.644276:0:23484:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.151@tcp to nid 0x20000c0a8cb97 (192.168.203.151@tcp) 00000020:01000000:0.0:1784584197.644299:0:23484:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1784584197.644301:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784584197.644313:0:23484:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff98b30247b380) 00000020:00000080:0.0:1784584197.644325:0:23484:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1784584197.644330:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784584197.644398:0:23484:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1784584197.644405:0:23484:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:0.0:1784584197.644410:0:23484:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdab2421a42e49448 00010000:00080000:0.0:1784584197.644440:0:23484:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b43e810800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.151@tcp at head 00010000:00010000:0.0:1784584197.644674:0:23484:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1784584197.644735:0:23484:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784584197.644749:0:23484:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:3.0:1784584197.645155:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599237376:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1784584197.645202:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871271599237376 offset 0 length 520: 4 00000040:00080000:0.0:1784584197.647198:0:23484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784584197.647602:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1784584197.647764:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000100:00080000:2.0:1784584197.648464:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584197.648488:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784584197.648491:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584197.648493:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1784584197.649059:0:23491:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1784584197.649065:0:23491:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1784584197.649699:0:23484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784584197.649710:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784584197.649744:0:23484:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1784584197.649766:0:23484:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdab2421a42e4944f 00000100:00080000:0.0:1784584197.649775:0:23484:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784584197.649780:0:23484:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98b43e810800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:0.0:1784584197.649816:0:23484:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b43c8ec380 x1871271599237504/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784584197.649874:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599237504:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1784584197.649934:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871271599237504 offset 0 length 520: 4 00000100:00080000:0.0:1784584197.653496:0:23484:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1784584197.653617:0:23484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584197.653625:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584197.653641:0:23484:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1784584197.653646:0:23484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584197.653649:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584197.653650:0:23484:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784584197.653653:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784584197.653655:0:23484:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784584197.653657:0:23484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584197.653659:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584197.653660:0:23484:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1784584197.653662:0:23484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584197.653665:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584197.653666:0:23484:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784584197.653670:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1784584197.653700:0:23484:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584197.653702:0:23484:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584197.653704:0:23484:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784584197.653706:0:23484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00080000:2.0:1784584197.654033:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584197.654038:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784584197.654041:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584197.654044:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1784584197.656042:0:23480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1784584197.656086:0:23480:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1784584197.656101:0:23480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e493d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e493d8 expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.656123:0:23480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b303b1da00/0xdab2421a42e493d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e493d8 expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584197.656131:0:23480:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98b4049d6000 from 1 10000000:01000000:3.0:1784584197.656134:0:23480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784584197.656171:0:23480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e49456 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.656177:0:23480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e49456 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.656186:0:23480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e49456 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584197.656207:0:23480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599237632:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784584197.656280:0:23480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584197.656316:0:23480:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b418129d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784584197.656446:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599237632 00000100:00100000:2.0:1784584197.656453:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599237632 00000100:00100000:2.0:1784584197.656519:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784584197.656527:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+15:23480:x1871271599237632:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784584197.656548:0:22741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584197.656568:0:22741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ea7ac00/0xdab2421a42e4945d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e49456 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584197.656593:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ea7ac00/0xdab2421a42e4945d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e49456 expref: 16 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584197.656603:0:22741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ea7ac00/0xdab2421a42e4945d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e49456 expref: 16 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584197.656612:0:22741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7ac00, rc 0) 00000100:00100000:2.0:1784584197.656647:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+16:23480:x1871271599237632:12345-0@lo:101:mount.lustre.0 Request processed in 121us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584197.656654:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784584197.656961:0:23480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599237632:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784584197.656979:0:23480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e49456 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4945d expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.656990:0:23480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e49456 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e4945d expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584197.658089:0:23480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599237760:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1784584197.658146:0:23480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584197.658187:0:23480:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b418129d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784584197.658311:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599237760 00000100:00100000:2.0:1784584197.658318:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599237760 00000100:00100000:2.0:1784584197.658369:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784584197.658377:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+16:23480:x1871271599237760:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1784584197.658394:0:22742:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1784584197.658413:0:22742:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784584197.658416:0:22742:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1784584197.658516:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+16:23480:x1871271599237760:12345-0@lo:256:mount.lustre.0 Request processed in 139us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584197.658524:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784584197.658574:0:23480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599237760:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1784584197.659302:0:23480:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784584197.659379:0:23480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e49456 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4945d expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584197.659397:0:23480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e49456 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4945d expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584197.659405:0:23480:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b4049d6000 from 1 10000000:01000000:2.0:1784584197.659408:0:23480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784584197.659434:0:23480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a600/0xdab2421a42e49464 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584197.659442:0:23480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a600/0xdab2421a42e49464 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584197.659452:0:23480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a600/0xdab2421a42e49464 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584197.659465:0:23480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437690a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599237888:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784584197.659513:0:23480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584197.659535:0:23480:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cba1180 going to sleep for 11 seconds 00000100:00100000:3.0:1784584197.659648:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599237888 00000100:00100000:3.0:1784584197.659654:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599237888 00000100:00100000:3.0:1784584197.659689:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784584197.659695:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+16:23480:x1871271599237888:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784584197.659706:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584197.659717:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b418982a00/0xdab2421a42e4946b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e49464 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.659735:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b418982a00/0xdab2421a42e4946b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e49464 expref: 17 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.659745:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b418982a00/0xdab2421a42e4946b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e49464 expref: 17 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.659753:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b418982a00, rc 0) 00000100:00100000:3.0:1784584197.659783:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+17:23480:x1871271599237888:12345-0@lo:101:mount.lustre.0 Request processed in 87us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584197.659790:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784584197.660985:0:23480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437690a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599237888:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784584197.661004:0:23480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a600/0xdab2421a42e49464 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4946b expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584197.661014:0:23480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a600/0xdab2421a42e49464 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e4946b expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784584197.662045:0:23480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:2.0:1784584197.662278:0:23480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784584197.662534:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1784584197.662569:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1784584197.662605:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1784584197.662620:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1784584197.662632:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1784584197.662643:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1784584197.662655:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1784584197.662667:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1784584197.662679:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1784584197.662691:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1784584197.662704:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1784584197.662720:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1784584197.662725:0:23480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:2.0:1784584197.662786:0:23480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437690a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599238016:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584197.663107:0:23480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584197.663189:0:23480:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cba1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784584197.663237:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599238016 00000100:00100000:3.0:1784584197.663243:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599238016 00000100:00100000:3.0:1784584197.663323:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784584197.663332:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+17:23480:x1871271599238016:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784584197.663449:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+17:23480:x1871271599238016:12345-0@lo:501:mount.lustre.0 Request processed in 118us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584197.663457:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784584197.663581:0:23480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437690a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599238016:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784584197.663614:0:23480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599238144:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784584197.663651:0:23480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584197.664701:0:23480:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039ef3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584197.665328:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599238144 00000100:00100000:2.0:1784584197.665337:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599238144 00000100:00100000:2.0:1784584197.665377:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784584197.665386:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+17:23480:x1871271599238144:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784584197.665526:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+17:23480:x1871271599238144:12345-0@lo:503:mount.lustre.0 Request processed in 141us (1875us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584197.665534:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784584197.665611:0:23480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599238144:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1784584197.666129:0:23480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784584197.666199:0:23480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599238272:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784584197.666253:0:23480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584197.666284:0:23480:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039ef3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584197.666451:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599238272 00000100:00100000:3.0:1784584197.666457:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599238272 00000100:00100000:3.0:1784584197.666521:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784584197.666529:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+17:23480:x1871271599238272:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584197.666649:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+17:23480:x1871271599238272:12345-0@lo:502:mount.lustre.0 Request processed in 120us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584197.666656:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784584197.666795:0:23480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599238272:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784584197.667130:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1784584197.667159:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:0.0:1784584197.667183:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:0.0:1784584197.667198:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:0.0:1784584197.667213:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:0.0:1784584197.667296:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:0.0:1784584197.667315:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:0.0:1784584197.667330:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:0.0:1784584197.667417:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1784584197.667433:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:0.0:1784584197.667448:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:0.0:1784584197.667505:0:23480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599238400:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784584197.667544:0:23480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584197.667579:0:23480:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039ef3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584197.667636:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599238400 00000100:00100000:1.0:1784584197.667641:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599238400 00000100:00100000:1.0:1784584197.667678:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784584197.667686:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+17:23480:x1871271599238400:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784584197.667767:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+17:23480:x1871271599238400:12345-0@lo:502:mount.lustre.0 Request processed in 81us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584197.667774:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784584197.668037:0:23480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599238400:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784584197.668075:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:0.0:1784584197.668083:0:23480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1784584197.669755:0:23493:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584197.669766:0:23493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584197.669769:0:23493:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784584197.669779:0:23493:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98b4049d6000 00000020:00000080:2.0:1784584197.669782:0:23493:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784584197.669789:0:23493:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584197.669791:0:23493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584197.669793:0:23493:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1784584197.669795:0:23493:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584197.669805:0:23493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584197.669807:0:23493:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784584197.669811:0:23493:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98b4049d6000 00000020:00000080:2.0:1784584197.669813:0:23493:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784584197.671615:0:23493:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584197.671626:0:23493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584197.671628:0:23493:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1784584197.671632:0:23493:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584197.671635:0:23493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584197.671637:0:23493:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784584197.671643:0:23493:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98b4049d6000 00000020:00000080:2.0:1784584197.671646:0:23493:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784584197.673503:0:23493:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584197.673514:0:23493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584197.673516:0:23493:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784584197.673520:0:23493:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584197.673523:0:23493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584197.673525:0:23493:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1784584197.673530:0:23493:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98b4049d6000 00000020:00000080:2.0:1784584197.673532:0:23493:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784584197.673600:0:23493:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584197.673604:0:23493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584197.673606:0:23493:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1784584197.673609:0:23493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:2.0:1784584197.673680:0:23480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1784584197.673709:0:23480:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784584197.673727:0:23480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a600/0xdab2421a42e49464 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4946b expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584197.673739:0:23480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a600/0xdab2421a42e49464 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4946b expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584197.673798:0:23480:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784584197.673807:0:23480:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98b4049d6000 10000000:01000000:2.0:1784584197.673811:0:23480:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98b4049d6000 10000000:01000000:2.0:1784584197.673815:0:23480:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784584197.673823:0:23480:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98b4049d6000 from 1 10000000:01000000:2.0:1784584197.673825:0:23480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784584197.679438:0:23480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ae00/0xdab2421a42e49472 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584197.679456:0:23480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ae00/0xdab2421a42e49472 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584197.679480:0:23480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ae00/0xdab2421a42e49472 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584197.679508:0:23480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437692300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599238528:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784584197.679586:0:23480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584197.679627:0:23480:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cba1240 going to sleep for 11 seconds 00000100:00100000:0.0:1784584197.680457:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599238528 00000100:00100000:0.0:1784584197.680480:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599238528 00000100:00100000:0.0:1784584197.680535:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784584197.680544:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+17:23480:x1871271599238528:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784584197.680570:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584197.680585:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b4332b9400/0xdab2421a42e49479 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e49472 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584197.680611:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4332b9400/0xdab2421a42e49479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e49472 expref: 18 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584197.680625:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b4332b9400/0xdab2421a42e49479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e49472 expref: 18 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584197.680633:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b9400, rc 0) 00000100:00100000:0.0:1784584197.680745:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+18:23480:x1871271599238528:12345-0@lo:101:mount.lustre.0 Request processed in 202us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584197.680751:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784584197.686054:0:23480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437692300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599238528:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784584197.686082:0:23480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ae00/0xdab2421a42e49472 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e49479 expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584197.686094:0:23480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ae00/0xdab2421a42e49472 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e49479 expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784584197.687895:0:23480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:2.0:1784584197.691956:0:23480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784584197.692134:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1784584197.692158:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:2.0:1784584197.692171:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:2.0:1784584197.692184:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:2.0:1784584197.692219:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:2.0:1784584197.692233:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:2.0:1784584197.692245:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:2.0:1784584197.692257:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:2.0:1784584197.692269:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1784584197.692281:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:2.0:1784584197.692293:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:2.0:1784584197.692306:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:2.0:1784584197.692318:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:2.0:1784584197.692330:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:2.0:1784584197.692419:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:2.0:1784584197.692433:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:2.0:1784584197.692445:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:2.0:1784584197.692457:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:2.0:1784584197.692494:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:2.0:1784584197.692510:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:2.0:1784584197.692535:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:2.0:1784584197.692550:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:2.0:1784584197.692575:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:2.0:1784584197.692593:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:2.0:1784584197.692606:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:2.0:1784584197.692620:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:2.0:1784584197.692633:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:2.0:1784584197.692645:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:2.0:1784584197.692658:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:2.0:1784584197.692670:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:2.0:1784584197.692681:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:2.0:1784584197.692693:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:2.0:1784584197.692706:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:2.0:1784584197.692718:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:2.0:1784584197.692730:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:2.0:1784584197.692742:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:2.0:1784584197.692768:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:2.0:1784584197.692789:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:2.0:1784584197.692803:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:2.0:1784584197.692815:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:2.0:1784584197.692827:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:2.0:1784584197.692840:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:2.0:1784584197.692853:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:2.0:1784584197.692865:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:2.0:1784584197.692876:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:2.0:1784584197.692889:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:2.0:1784584197.692902:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:2.0:1784584197.692915:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:2.0:1784584197.693030:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:2.0:1784584197.693050:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:2.0:1784584197.693066:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:2.0:1784584197.693071:0:23480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:2.0:1784584197.693161:0:23480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437692300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599238656:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584197.693224:0:23480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584197.693274:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599238656 00000100:00100000:2.0:1784584197.693280:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599238656 00000100:00100000:2.0:1784584197.693321:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784584197.693329:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+18:23480:x1871271599238656:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584197.693756:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+18:23480:x1871271599238656:12345-0@lo:501:mount.lustre.0 Request processed in 427us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584197.693765:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784584197.693811:0:23480:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cba16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584197.693832:0:23480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437692300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599238656:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584197.693863:0:23480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437692300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599238784:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784584197.693904:0:23480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584197.693965:0:23480:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cba16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584197.698703:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599238784 00000100:00100000:3.0:1784584197.698717:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599238784 00000100:00100000:3.0:1784584197.698776:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784584197.698788:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c231c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+18:23480:x1871271599238784:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784584197.698961:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c231c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+18:23480:x1871271599238784:12345-0@lo:503:mount.lustre.0 Request processed in 176us (5057us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584197.698970:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784584197.699293:0:23480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437692300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599238784:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784584197.699837:0:23480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784584197.699922:0:23480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437692300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599238912:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784584197.699971:0:23480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584197.700005:0:23480:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cba1240 going to sleep for 11 seconds 00000100:00100000:3.0:1784584197.700283:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599238912 00000100:00100000:3.0:1784584197.700289:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599238912 00000100:00100000:3.0:1784584197.700409:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784584197.700418:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+18:23480:x1871271599238912:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584197.700544:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+18:23480:x1871271599238912:12345-0@lo:502:mount.lustre.0 Request processed in 127us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584197.700552:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784584197.700695:0:23480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437692300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599238912:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784584197.700875:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1784584197.700904:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:2.0:1784584197.700922:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:2.0:1784584197.700935:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:2.0:1784584197.700949:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:2.0:1784584197.700962:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:2.0:1784584197.700978:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:2.0:1784584197.700993:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:2.0:1784584197.701007:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1784584197.701022:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:2.0:1784584197.701036:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:2.0:1784584197.701049:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:2.0:1784584197.701066:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:2.0:1784584197.701096:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:2.0:1784584197.701111:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:2.0:1784584197.701122:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:2.0:1784584197.701134:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:2.0:1784584197.701145:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:2.0:1784584197.701157:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:2.0:1784584197.701172:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:2.0:1784584197.701183:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:2.0:1784584197.701194:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:2.0:1784584197.701206:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:2.0:1784584197.701232:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:2.0:1784584197.701248:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:2.0:1784584197.701261:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:2.0:1784584197.701275:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:2.0:1784584197.701287:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:2.0:1784584197.701300:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:2.0:1784584197.701329:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:2.0:1784584197.702510:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:2.0:1784584197.702534:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:2.0:1784584197.702550:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:2.0:1784584197.702575:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:2.0:1784584197.702591:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:2.0:1784584197.702603:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:2.0:1784584197.702615:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:2.0:1784584197.702628:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:2.0:1784584197.702642:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:2.0:1784584197.702657:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:2.0:1784584197.702672:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:2.0:1784584197.702688:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:2.0:1784584197.702702:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:2.0:1784584197.702717:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:2.0:1784584197.702731:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:2.0:1784584197.702761:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:2.0:1784584197.702778:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:2.0:1784584197.702791:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:2.0:1784584197.702841:0:23480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437692300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599239040:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784584197.702909:0:23480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584197.702958:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599239040 00000100:00100000:2.0:1784584197.702965:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599239040 00000100:00100000:2.0:1784584197.703009:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784584197.703017:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+18:23480:x1871271599239040:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784584197.703131:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+18:23480:x1871271599239040:12345-0@lo:502:mount.lustre.0 Request processed in 115us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584197.703140:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784584197.703192:0:23480:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cba1240 going to sleep for 11 seconds 00000100:00100000:2.0:1784584197.703214:0:23480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437692300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599239040:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784584197.703725:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1784584197.703751:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1784584197.703777:0:23480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437692300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599239168:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784584197.703816:0:23480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584197.703846:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599239168 00000100:00100000:2.0:1784584197.703851:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599239168 00000100:00100000:2.0:1784584197.703880:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784584197.703887:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+18:23480:x1871271599239168:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784584197.703953:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+18:23480:x1871271599239168:12345-0@lo:502:mount.lustre.0 Request processed in 65us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584197.703960:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784584197.703996:0:23480:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cba1240 going to sleep for 11 seconds 00000100:00100000:2.0:1784584197.704009:0:23480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437692300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599239168:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784584197.704043:0:23480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:2.0:1784584197.704050:0:23480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1784584197.710994:0:23498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1784584197.711010:0:23498:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff98b4331e19c0) 00000020:00000080:1.0:1784584197.711031:0:23498:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1784584197.711194:0:23498:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98b4049d6000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1784584197.711198:0:23498:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98b4049d6000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1784584197.711200:0:23498:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b4049d6000 3 00010000:00080000:1.0:1784584197.711238:0:23498:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b402c30000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.151@tcp at head 00010000:00010000:1.0:1784584197.717555:0:23498:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1784584197.717668:0:23498:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1784584197.717712:0:23498:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784584197.717724:0:23498:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xdab2421a42e49487 00000100:00080000:1.0:1784584197.717733:0:23498:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784584197.717739:0:23498:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98b402c30000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:1.0:1784584197.717772:0:23498:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b43efaa300 x1871271599239296/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784584197.717800:0:23498:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784584197.717828:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784584197.717831:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784584197.717834:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784584197.717845:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784584197.718068:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1871271599239296:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784584197.718140:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584197.720098:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599239296 00000100:00100000:1.0:1784584197.720110:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599239296 00000100:00100000:1.0:1784584197.720157:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784584197.720165:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1871271599239296:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1784584197.720194:0:22749:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 640 last 0 00000020:00000080:1.0:1784584197.720231:0:22749:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xdab2421a42e4948e 00000004:00100000:1.0:1784584197.720245:0:22749:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784584197.720289:0:22749:0:(import.c:65:import_set_state_nolock()) ffff98b410738800 : changing import state from RECOVER to FULL 00000040:00080000:2.0:1784584197.720670:0:23498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:2.0:1784584197.720775:0:23480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1784584197.720805:0:23480:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784584197.720827:0:23480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ae00/0xdab2421a42e49472 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e49479 expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584197.720839:0:23480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ae00/0xdab2421a42e49472 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e49479 expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784584197.720888:0:23480:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784584197.720890:0:23480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784584197.720892:0:23480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784584197.720893:0:23480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784584197.720894:0:23480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784584197.720896:0:23480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784584197.720897:0:23480:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784584197.720898:0:23480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784584197.720900:0:23480:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784584197.720903:0:23480:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1784584197.720906:0:23480:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784584197.720907:0:23480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784584197.720908:0:23480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784584197.720909:0:23480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784584197.720910:0:23480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784584197.720912:0:23480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784584197.720912:0:23480:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784584197.720913:0:23480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784584197.720914:0:23480:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784584197.720932:0:23480:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1784584197.720948:0:23480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437690380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599239424:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784584197.720991:0:23480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584197.721019:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599239424 00000100:00100000:2.0:1784584197.721022:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599239424 00000100:00100000:2.0:1784584197.721054:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784584197.721061:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+18:23480:x1871271599239424:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784584197.721080:0:22740:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1784584197.721092:0:22740:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1784584197.721212:0:23480:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cba13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584197.721521:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1871271599239296:12345-0@lo:38:llog_process_th.0 Request processed in 1353us (3379us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584197.721529:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1784584197.722117:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98b43efaa300 x1871271599239296/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784584207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584197.722128:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784584197.722137:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1784584197.722144:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1784584197.722149:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784584197.722152:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b402c30000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784584197.722158:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1871271599239296:0@lo:38:llog_process_th.0 00000001:00100000:2.0:1784584197.724709:0:22727:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1784584197.725696:0:22740:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784584197.725744:0:22740:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1784584197.725808:0:22763:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784584197.725814:0:22763:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784584197.725836:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98b418982200/0xdab2421a42e49495 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.725856:0:22763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b418983c00/0xdab2421a42e49399 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e49392 expref: 18 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.725865:0:22763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b43ea7ac00/0xdab2421a42e4945d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e49456 expref: 18 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.725880:0:22763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98b418982200/0xdab2421a42e49495 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.725924:0:22763:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b43ea7ac00/0xdab2421a42e4945d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e49456 expref: 18 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.725938:0:22763:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b43ea7ac00/0xdab2421a42e4945d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e49456 expref: 18 pid: 22741 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584197.725954:0:22763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b45500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22763:1871271599239552:0@lo:104: 00000100:00100000:3.0:1784584197.726012:0:22763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784584197.726056:0:22763:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b418983c00/0xdab2421a42e49399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e49392 expref: 18 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.726065:0:22763:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b418983c00/0xdab2421a42e49399 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e49392 expref: 18 pid: 22741 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584197.726073:0:22763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b47100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22763:1871271599239680:0@lo:104: 00000100:00100000:3.0:1784584197.726094:0:22763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584197.726110:0:22763:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b405164000 going to sleep for 11 seconds 00000100:00100000:3.0:1784584197.726128:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599239552 00000100:00100000:3.0:1784584197.726133:0:22730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599239552 00000100:00100000:3.0:1784584197.726164:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599239680 00000100:00100000:3.0:1784584197.726167:0:22730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599239680 00000100:00100000:3.0:1784584197.726179:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784584197.726187:0:22730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:954867da-9a7c-4a17-b608-74c1de1cda93+4:22763:x1871271599239552:12345-0@lo:104: 00010000:00010000:3.0:1784584197.726197:0:22730:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e49456 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e4945d expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.726252:0:22730:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784584197.726258:0:22730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:954867da-9a7c-4a17-b608-74c1de1cda93+4:22763:x1871271599239552:12345-0@lo:104: Request processed in 72us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584197.726265:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784584197.726280:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784584197.726286:0:22730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:954867da-9a7c-4a17-b608-74c1de1cda93+3:22763:x1871271599239680:12345-0@lo:104: 00010000:00010000:3.0:1784584197.726293:0:22730:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b43ea7aa00/0xdab2421a42e49392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e49399 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.726324:0:22730:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784584197.726329:0:22730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:954867da-9a7c-4a17-b608-74c1de1cda93+3:22763:x1871271599239680:12345-0@lo:104: Request processed in 43us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584197.727655:0:22763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b45500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22763:1871271599239552:0@lo:104: 00000100:00100000:2.0:1784584197.727667:0:22763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b47100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22763:1871271599239680:0@lo:104: 00010000:00010000:2.0:1784584197.727690:0:22763:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98b418982200/0xdab2421a42e49495 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584197.728748:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1784584197.728789:0:22735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784584197.728797:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e49456 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e4945d expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.728808:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982e00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:3.0:1784584197.728813:0:22735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e49456 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e4945d expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.728822:0:22735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e49456 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e4945d expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784584197.728830:0:22735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e49456 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e4945d expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584197.728836:0:22735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784584197.728889:0:22735:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e49456 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4945d expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.728895:0:22735:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1784584197.729075:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+18:23480:x1871271599239424:12345-0@lo:253:mount.lustre.0 Request processed in 8012us (8081us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584197.729084:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784584197.729132:0:23480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437690380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:23480:1871271599239424:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784584197.729144:0:23480:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1784584197.729147:0:23480:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784584197.729149:0:23480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784584197.729151:0:23480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784584197.729152:0:23480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784584197.729154:0:23480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784584197.729155:0:23480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784584197.729156:0:23480:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784584197.729158:0:23480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784584197.729167:0:23480:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784584197.729181:0:23480:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1784584197.730452:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e49456 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4945d expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.730476:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b418982e00/0xdab2421a42e49456 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4945d expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.730491:0:22735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584197.730495:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b43ea7aa00/0xdab2421a42e49392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e49399 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.730502:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7aa00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:3.0:1784584197.730506:0:22735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b43ea7aa00/0xdab2421a42e49392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e49399 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.730515:0:22735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b43ea7aa00/0xdab2421a42e49392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e49399 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784584197.730522:0:22735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b43ea7aa00/0xdab2421a42e49392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e49399 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584197.730528:0:22735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784584197.730554:0:22735:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b43ea7aa00/0xdab2421a42e49392 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e49399 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.730573:0:22735:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784584197.730591:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7aa00/0xdab2421a42e49392 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e49399 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.730608:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b43ea7aa00/0xdab2421a42e49392 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e49399 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.730623:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584197.730625:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584197.730627:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584197.730635:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584197.730649:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:954867da-9a7c-4a17-b608-74c1de1cda93:3642:1871271599239808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584197.730702:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584197.730753:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:954867da-9a7c-4a17-b608-74c1de1cda93:3639:1871271599239936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584197.730775:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584197.730834:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599239808 00000100:00100000:3.0:1784584197.730840:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599239808 00010000:00010000:3.0:1784584197.730864:0:22733:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b43ea7ac00/0xdab2421a42e4945d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e49456 expref: 18 pid: 22741 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584197.730885:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599239936 00000100:00100000:3.0:1784584197.730888:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599239936 00010000:00010000:3.0:1784584197.730898:0:22733:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b418983c00/0xdab2421a42e49399 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e49392 expref: 19 pid: 22741 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584197.730909:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784584197.730916:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:954867da-9a7c-4a17-b608-74c1de1cda93+19:3642:x1871271599239808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784584197.730927:0:22733:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584197.730932:0:22733:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b43ea7ac00/0xdab2421a42e4945d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e49456 expref: 19 pid: 22741 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.730953:0:22733:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b43ea7ac00/0xdab2421a42e4945d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e49456 expref: 19 pid: 22741 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.730966:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b43ea7ac00/0xdab2421a42e4945d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e49456 expref: 19 pid: 22741 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.730978:0:22733:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584197.731009:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:954867da-9a7c-4a17-b608-74c1de1cda93+18:3642:x1871271599239808:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584197.731015:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784584197.731029:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784584197.731035:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:954867da-9a7c-4a17-b608-74c1de1cda93+17:3639:x1871271599239936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784584197.731052:0:22733:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584197.731056:0:22733:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b418983c00/0xdab2421a42e49399 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e49392 expref: 17 pid: 22741 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.731065:0:22733:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b418983c00/0xdab2421a42e49399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e49392 expref: 17 pid: 22741 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.731075:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b418983c00/0xdab2421a42e49399 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e49392 expref: 17 pid: 22741 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.731087:0:22733:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98b418982200/0xdab2421a42e49495 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.731094:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b418982200/0xdab2421a42e49495 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784584197.731108:0:22733:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.018163401s 00010000:00010000:3.0:1784584197.731118:0:22733:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b418982200/0xdab2421a42e49495 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.731124:0:22733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b418982200/0xdab2421a42e49495 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.731131:0:22733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98b418982200/0xdab2421a42e49495 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.731137:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98b418982200/0xdab2421a42e49495 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.731143:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982200 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584197.731147:0:22733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98b418982200/0xdab2421a42e49495 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.731154:0:22733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98b418982200/0xdab2421a42e49495 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.731168:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98b418982200/0xdab2421a42e49495 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.731177:0:22733:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584197.731203:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:954867da-9a7c-4a17-b608-74c1de1cda93+16:3639:x1871271599239936:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584197.731209:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784584197.731244:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:954867da-9a7c-4a17-b608-74c1de1cda93:3642:1871271599239808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584197.731268:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:954867da-9a7c-4a17-b608-74c1de1cda93:3639:1871271599239936:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784584197.731285:0:22763:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98b418982200/0xdab2421a42e49495 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.731302:0:22763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98b418982200/0xdab2421a42e49495 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584197.731308:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b418982200/0xdab2421a42e49495 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:3.0:1784584197.735885:0:23480:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1784584197.739311:0:23504:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1784584197.739318:0:23504:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1784584197.741308:0:23505:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1784584197.741506:0:23480:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1784584197.741893:0:23506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efaa300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23506:1871271599240064:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1784584197.741980:0:23506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584197.742008:0:23506:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4074c70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584197.742110:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599240064 00000100:00100000:2.0:1784584197.742119:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599240064 00000100:00100000:2.0:1784584197.742160:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784584197.742168:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23506:x1871271599240064:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1784584197.742249:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23506:x1871271599240064:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 81us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584197.742257:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:01000000:2.0:1784584197.742392:0:23480:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1784584197.742443:0:23480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1784584197.742874:0:23480:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1784584197.742881:0:23480:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1784584197.743161:0:23480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784584197.743591:0:23506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efaa300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23506:1871271599240064:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1784584197.743626:0:23506:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1784584197.743664:0:23506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efaa300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23506:1871271599240192:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1784584197.743711:0:23506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584197.743734:0:23506:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4074c7780 going to sleep for 11 seconds 00000040:00080000:1.0:1784584197.745111:0:23505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784584197.746104:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599240192 00000100:00100000:0.0:1784584197.746115:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599240192 00000100:00100000:0.0:1784584197.746156:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784584197.746165:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23506:x1871271599240192:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1784584197.746348:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23506:x1871271599240192:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 184us (2635us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584197.746356:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784584197.746397:0:23506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efaa300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23506:1871271599240192:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1784584197.746485:0:23506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8edc00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23506:1871271599240320:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1784584197.746520:0:23506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584197.746547:0:23506:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039efc00 going to sleep for 11 seconds 00000040:00080000:2.0:1784584197.747272:0:23480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1784584197.748082:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599240320 00000100:00100000:3.0:1784584197.748090:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599240320 00000100:00100000:3.0:1784584197.748133:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784584197.748142:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23506:x1871271599240320:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1784584197.748215:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23506:x1871271599240320:12345-0@lo:900:lod0001_rec0000.0 Request processed in 74us (1693us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584197.748221:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1784584197.749859:0:23506:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98b43c8edc00 x1871271599240320/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784584213 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584197.749877:0:23506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8edc00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23506:1871271599240320:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1784584197.749965:0:23506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8edc00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23506:1871271599240448:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1784584197.750018:0:23506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584197.750050:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599240448 00000100:00100000:0.0:1784584197.750055:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599240448 00000100:00100000:0.0:1784584197.750093:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784584197.750100:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23506:x1871271599240448:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1784584197.750164:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23506:x1871271599240448:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 64us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584197.750184:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784584197.750205:0:23506:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039ef0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784584197.750218:0:23506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8edc00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23506:1871271599240448:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1784584197.750263:0:23506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784584197.751137:0:23480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1784584197.751196:0:23480:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1784584197.752451:0:23480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1784584197.754626:0:23480:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000040:00080000:1.0:1784584197.756766:0:23505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1784584197.756835:0:23505:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1784584197.758799:0:23506:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1784584197.758873:0:23506:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1784584197.758877:0:23506:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:3.0:1784584197.759665:0:23480:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1784584197.766660:0:23480:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1784584197.766704:0:23480:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbb9d45563988 00100000:10000000:3.0:1784584197.766711:0:23480:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1784584197.767779:0:23480:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784584197.767810:0:23480:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.151@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784584197.767830:0:23480:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1784584197.767848:0:23480:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1784584197.771041:0:23480:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784584197.773709:0:23480:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784584198.126414:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584198.576760:0:22789:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039ef600 going to sleep for 0 seconds 00000040:00080000:1.0:1784584198.766137:0:23502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1784584198.829583:0:22744:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784584198.829591:0:22744:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98b4049d6000 from 12 10000000:01000000:3.0:1784584198.829596:0:22744:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784584198.829642:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e4949c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584198.829653:0:22744:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e4949c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584198.829681:0:22744:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e4949c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584198.829706:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599240576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784584198.829771:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584198.829814:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8f540 going to sleep for 11 seconds 00000100:00100000:2.0:1784584198.829893:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599240576 00000100:00100000:2.0:1784584198.829900:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599240576 00000100:00100000:2.0:1784584198.829954:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784584198.829963:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c231850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+16:22744:x1871271599240576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784584198.829985:0:22741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584198.829998:0:22741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ea7ba00/0xdab2421a42e494a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e4949c expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584198.830019:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ea7ba00/0xdab2421a42e494a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e4949c expref: 17 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584198.830029:0:22741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ea7ba00/0xdab2421a42e494a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e4949c expref: 17 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584198.830047:0:22741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7ba00, rc 0) 00000100:00100000:2.0:1784584198.830095:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c231850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+17:22744:x1871271599240576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584198.830101:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784584198.830241:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599240576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784584198.830264:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e4949c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e494a3 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584198.830273:0:22744:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e4949c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e494a3 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584198.830323:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599240704:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784584198.830357:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584198.830378:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4074c7780 going to sleep for 11 seconds 00000100:00100000:3.0:1784584198.830492:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599240704 00000100:00100000:3.0:1784584198.830496:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599240704 00000100:00100000:3.0:1784584198.830529:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784584198.830536:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+17:22744:x1871271599240704:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784584198.830550:0:22742:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784584198.830574:0:22742:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784584198.830577:0:22742:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1784584198.830651:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+17:22744:x1871271599240704:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584198.830659:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784584198.831158:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599240704:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784584198.831198:0:22744:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784584198.831205:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e4949c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e494a3 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584198.831213:0:22744:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e4949c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e494a3 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584198.831222:0:22744:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784584198.831224:0:22744:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98b405f11000 from 12 10000000:01000000:1.0:1784584198.831226:0:22744:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784584198.831244:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1c800/0xdab2421a42e494aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584198.831251:0:22744:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b303b1c800/0xdab2421a42e494aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584198.831259:0:22744:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b303b1c800/0xdab2421a42e494aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584198.831282:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599240832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784584198.831307:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584198.831326:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4074c7780 going to sleep for 11 seconds 00000100:00100000:2.0:1784584198.832076:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599240832 00000100:00100000:2.0:1784584198.832084:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599240832 00000100:00100000:2.0:1784584198.832127:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784584198.832136:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+17:22744:x1871271599240832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784584198.832147:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584198.832159:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ea7b800/0xdab2421a42e494b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e494aa expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584198.832177:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ea7b800/0xdab2421a42e494b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e494aa expref: 18 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584198.832186:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ea7b800/0xdab2421a42e494b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e494aa expref: 18 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584198.832193:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7b800, rc 0) 00000100:00100000:2.0:1784584198.832245:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+18:22744:x1871271599240832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584198.832252:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784584198.832453:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599240832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784584198.832479:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b303b1c800/0xdab2421a42e494aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e494b1 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584198.832488:0:22744:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b303b1c800/0xdab2421a42e494aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e494b1 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584198.832533:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599240960:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784584198.832577:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584198.832594:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4074c7780 going to sleep for 11 seconds 00000100:00100000:0.0:1784584198.835919:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599240960 00000100:00100000:0.0:1784584198.835935:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599240960 00000100:00100000:0.0:1784584198.836537:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784584198.836549:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c233c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+18:22744:x1871271599240960:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784584198.836584:0:22741:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784584198.836607:0:22741:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784584198.836611:0:22741:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1784584198.836920:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c233c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+18:22744:x1871271599240960:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 373us (4340us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584198.836928:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784584198.837106:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599240960:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784584198.837160:0:22744:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784584198.837169:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1c800/0xdab2421a42e494aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e494b1 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584198.837179:0:22744:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b303b1c800/0xdab2421a42e494aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e494b1 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584199.149949:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584199.597560:0:22789:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039ef600 going to sleep for 0 seconds 00000040:00080000:0.0:1784584199.792789:0:23502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784584200.176852:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584200.622573:0:22789:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039ef600 going to sleep for 0 seconds 00010000:00010000:0.0:1784584201.197597:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584201.646569:0:22789:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039ef600 going to sleep for 0 seconds 00000001:02000400:1.0:1784584201.912732:0:23749:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1784584202.222079:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584202.670816:0:22789:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039ef600 going to sleep for 0 seconds 00000020:00000004:0.0:1784584202.724126:0:23801:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784584202.724302:0:23801:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1784584202.925676:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599241088:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784584202.925745:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584202.925838:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599241088 00000100:00100000:0.0:1784584202.925845:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599241088 00000100:00100000:0.0:1784584202.925913:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784584202.925923:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599241088:12345-0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1784584202.926070:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784584202.926074:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1784584202.926077:0:38:0:(import.c:65:import_set_state_nolock()) ffff98b3040b2000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784584202.926084:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98b3040b2000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:3.0:1784584202.926103:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b302b45180 x1871271599241344/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784584202.926130:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784584202.926133:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784584202.926136:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784584202.926138:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784584202.926149:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784584202.926152:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784584202.926154:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784584202.926157:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784584202.926180:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599241472:0@lo:400:kworker.0 00000100:00100000:3.0:1784584202.926211:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584202.926229:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784584202.926235:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:954867da-9a7c-4a17-b608-74c1de1cda93:3642:1871271599241216:0@lo:400:kworker.0 00000100:00100000:3.0:1784584202.926259:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584202.926288:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599241344:0@lo:38:kworker.0 00000100:00100000:3.0:1784584202.926310:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584202.926335:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599241600:0@lo:400:kworker.0 00000100:00100000:3.0:1784584202.926360:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584202.926397:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599241472 00000100:00100000:3.0:1784584202.926401:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599241472 00000100:00100000:1.0:1784584202.926419:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599241600 00000100:00100000:1.0:1784584202.926424:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599241600 00000100:00100000:3.0:1784584202.926429:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784584202.926435:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599241472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584202.926440:0:22748:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1784584202.926451:0:22748:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1784584202.926496:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599241472:12345-0@lo:400:kworker.0 Request processed in 59us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584202.926508:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784584202.926524:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784584202.926541:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599241600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584202.926573:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599241600:12345-0@lo:400:kworker.0 Request processed in 32us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584202.926579:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784584202.926595:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599241216 00000100:00100000:3.0:1784584202.926598:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599241216 00000100:00100000:3.0:1784584202.926621:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784584202.926628:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+18:3642:x1871271599241216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584202.926659:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+18:3642:x1871271599241216:12345-0@lo:400:kworker.0 Request processed in 33us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584202.926665:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784584202.926694:0:22753:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1784584202.926699:0:22753:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00080000:3.0:1784584202.926736:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98b302b47800 x1871271599241600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584202.926747:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599241600:0@lo:400:kworker.0 00000100:00100000:3.0:1784584202.926769:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:954867da-9a7c-4a17-b608-74c1de1cda93:3642:1871271599241216:0@lo:400:kworker.0 00010000:00080000:3.0:1784584202.926777:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98b302b46300 x1871271599241472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584202.926785:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599241472:0@lo:400:kworker.0 00000004:00000024:0.0:1784584202.927126:0:22752:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1784584202.927179:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599241088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1258us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584202.927187:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784584202.927201:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599241344 00000100:00100000:0.0:1784584202.927204:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599241344 00000100:00100000:0.0:1784584202.927217:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784584202.927221:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1871271599241344:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1784584202.927244:0:22752:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 646 last 0 00000020:00000080:0.0:1784584202.927274:0:22752:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdab2421a42e494b8 00000004:00100000:0.0:1784584202.927287:0:22752:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1784584202.927292:0:22752:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1784584202.927411:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599241088:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1784584202.939884:0:22752:0:(import.c:65:import_set_state_nolock()) ffff98b41073c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784584202.939986:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1871271599241344:12345-0@lo:38:kworker.0 Request processed in 12761us (13672us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584202.940001:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1784584202.940063:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1784584202.940082:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1784584202.940087:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1784584202.940090:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b3040b2000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1784584202.940111:0:3638:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000009a79f0d2): req@ffff98b43c8ece00 x1871271599234304/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584202.940137:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599241344:0@lo:38:kworker.0 00000100:00100000:1.0:1784584202.940216:0:22789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584202.940244:0:22789:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3039ef600 going to sleep for 11 seconds 00000100:00100000:3.0:1784584202.940252:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599234304 00000100:00100000:3.0:1784584202.940258:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599234304 00000100:00100000:3.0:1784584202.940295:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784584202.940303:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22789:x1871271599234304:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784584202.940392:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22789:x1871271599234304:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 90us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584202.940400:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784584202.940420:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599241728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784584202.940420:0:22789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ece00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22789:1871271599234304:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784584202.940443:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:1.0:1784584202.940453:0:22789:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1784584202.940504:0:22789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efab100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22789:1871271599241856:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784584202.940505:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599241728 00000100:00100000:3.0:1784584202.940508:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599241728 00000100:00100000:3.0:1784584202.940541:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784584202.940543:0:22789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584202.940547:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1871271599241728:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784584202.940552:0:22789:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab1c00 going to sleep for 11 seconds 00000004:00000024:3.0:1784584202.940567:0:22752:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1784584202.940602:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1871271599241728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584202.940609:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784584202.940618:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599241856 00000100:00100000:3.0:1784584202.940621:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599241856 00000100:00100000:3.0:1784584202.940634:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784584202.940645:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22789:x1871271599241856:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784584202.940727:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22789:x1871271599241856:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 82us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584202.940733:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784584202.940757:0:22789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efab100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22789:1871271599241856:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784584202.940823:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599241728:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784584202.940830:0:22789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b46300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22789:1871271599241984:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784584202.940854:0:22789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584202.940875:0:22789:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8f000 going to sleep for 11 seconds 00000100:00100000:3.0:1784584202.940889:0:23818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599241984 00000100:00100000:3.0:1784584202.940892:0:23818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599241984 00000100:00100000:3.0:1784584202.940922:0:23818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784584202.940928:0:23818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22789:x1871271599241984:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784584202.940983:0:23818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22789:x1871271599241984:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 55us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584202.940990:0:23818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784584202.941012:0:22789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b46300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22789:1871271599241984:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1784584202.941210:0:22789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784584202.948430:0:22789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784584202.948534:0:22789:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 17, retries 0 00000004:00080000:3.0:1784584202.948540:0:22789:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1784584203.246574:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784584203.582347:0:23853:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784584203.582642:0:23853:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784584204.270092:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784584204.696746:0:23901:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf27d0880 20000000:00000080:2.0:1784584204.696762:0:23901:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98b41075a400 uarg=0000000000000000 20000000:01000000:2.0:1784584204.696800:0:23901:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1784584204.696806:0:23901:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1784584204.696810:0:23901:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1784584204.697446:0:23902:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1784584204.697757:0:23901:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1784584204.705163:0:23901:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1784584204.705196:0:23901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98b418982e00/0xdab2421a42e494bf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584204.705217:0:23901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b43ea7be00/0xdab2421a42e49368 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e49361 expref: 17 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584204.705242:0:23901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b418982a00/0xdab2421a42e4946b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e49464 expref: 17 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584204.705250:0:23901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98b418982e00/0xdab2421a42e494bf lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584204.705295:0:23901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b418982a00/0xdab2421a42e4946b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e49464 expref: 17 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584204.705311:0:23901:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b418982a00/0xdab2421a42e4946b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e49464 expref: 17 pid: 22740 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584204.705328:0:23901:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b46300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23901:1871271599242112:0@lo:104: 00000100:00100000:3.0:1784584204.705397:0:23901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784584204.705786:0:23901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b43ea7be00/0xdab2421a42e49368 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e49361 expref: 17 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584204.705797:0:23901:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b43ea7be00/0xdab2421a42e49368 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e49361 expref: 17 pid: 22741 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584204.705809:0:23901:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b47b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23901:1871271599242240:0@lo:104: 00000100:00100000:3.0:1784584204.705839:0:23901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584204.705859:0:23901:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8f000 going to sleep for 11 seconds 00000100:00100000:2.0:1784584204.706903:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599242112 00000100:00100000:2.0:1784584204.706927:0:22730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599242112 00000100:00100000:2.0:1784584204.706971:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599242240 00000100:00100000:2.0:1784584204.706975:0:22730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599242240 00000100:00100000:2.0:1784584204.706992:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784584204.707011:0:22730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:954867da-9a7c-4a17-b608-74c1de1cda93+4:23901:x1871271599242112:12345-0@lo:104: 00010000:00010000:2.0:1784584204.707027:0:22730:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a600/0xdab2421a42e49464 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e4946b expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584204.707108:0:22730:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784584204.707115:0:22730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:954867da-9a7c-4a17-b608-74c1de1cda93+4:23901:x1871271599242112:12345-0@lo:104: Request processed in 105us (1720us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584204.707123:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784584204.707135:0:23901:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b46300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23901:1871271599242112:0@lo:104: 00000100:00100000:2.0:1784584204.707144:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784584204.707154:0:22730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:954867da-9a7c-4a17-b608-74c1de1cda93+3:23901:x1871271599242240:12345-0@lo:104: 00010000:00010000:2.0:1784584204.707176:0:22730:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b4332b9600/0xdab2421a42e49361 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e49368 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584204.707222:0:22730:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784584204.707229:0:22730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:954867da-9a7c-4a17-b608-74c1de1cda93+3:23901:x1871271599242240:12345-0@lo:104: Request processed in 76us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584204.707236:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784584204.707240:0:23901:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b47b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23901:1871271599242240:0@lo:104: 00010000:00010000:2.0:1784584204.707259:0:22735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784584204.707266:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a600/0xdab2421a42e49464 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e4946b expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584204.707271:0:23901:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98b418982e00/0xdab2421a42e494bf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584204.707433:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7a600 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:2.0:1784584204.707438:0:22735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a600/0xdab2421a42e49464 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e4946b expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584204.707447:0:22735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a600/0xdab2421a42e49464 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e4946b expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784584204.707455:0:22735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a600/0xdab2421a42e49464 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e4946b expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584204.707462:0:22735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784584204.707530:0:22735:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a600/0xdab2421a42e49464 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4946b expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584204.707537:0:22735:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784584204.707565:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a600/0xdab2421a42e49464 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4946b expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584204.707573:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a600/0xdab2421a42e49464 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4946b expref: -99 pid: 23480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584204.707587:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:954867da-9a7c-4a17-b608-74c1de1cda93:3641:1871271599242368:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784584204.707608:0:22735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584204.707613:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b4332b9600/0xdab2421a42e49361 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e49368 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584204.707620:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4332b9600 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:2.0:1784584204.707624:0:22735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b4332b9600/0xdab2421a42e49361 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e49368 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584204.707627:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784584204.707638:0:22735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b4332b9600/0xdab2421a42e49361 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e49368 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784584204.707646:0:22735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b4332b9600/0xdab2421a42e49361 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e49368 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584204.707651:0:22735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1784584204.707669:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599242368 00000100:00100000:3.0:1784584204.707674:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599242368 00010000:00010000:2.0:1784584204.707676:0:22735:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b4332b9600/0xdab2421a42e49361 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e49368 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584204.707684:0:22735:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784584204.707695:0:22732:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b418982a00/0xdab2421a42e4946b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e49464 expref: 18 pid: 22740 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584204.707698:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b4332b9600/0xdab2421a42e49361 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e49368 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584204.707713:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b4332b9600/0xdab2421a42e49361 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e49368 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584204.707725:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1784584204.707729:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584204.707734:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:954867da-9a7c-4a17-b608-74c1de1cda93+18:3641:x1871271599242368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784584204.707734:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584204.707738:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584204.707748:0:22732:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1784584204.707752:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:954867da-9a7c-4a17-b608-74c1de1cda93:3642:1871271599242496:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784584204.707757:0:22732:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b418982a00/0xdab2421a42e4946b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e49464 expref: 18 pid: 22740 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584204.707773:0:22732:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b418982a00/0xdab2421a42e4946b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e49464 expref: 18 pid: 22740 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584204.707790:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b418982a00/0xdab2421a42e4946b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e49464 expref: 18 pid: 22740 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584204.707799:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784584204.707807:0:22732:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584204.707841:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:954867da-9a7c-4a17-b608-74c1de1cda93+17:3641:x1871271599242368:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584204.707849:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784584204.707858:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:954867da-9a7c-4a17-b608-74c1de1cda93:3641:1871271599242368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584204.707863:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599242496 00000100:00100000:3.0:1784584204.707867:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599242496 00010000:00010000:3.0:1784584204.707880:0:22732:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b43ea7be00/0xdab2421a42e49368 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e49361 expref: 17 pid: 22741 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584204.707906:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784584204.707912:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437691180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:954867da-9a7c-4a17-b608-74c1de1cda93+17:3642:x1871271599242496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784584204.707919:0:22732:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584204.707923:0:22732:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b43ea7be00/0xdab2421a42e49368 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e49361 expref: 17 pid: 22741 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584204.707932:0:22732:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b43ea7be00/0xdab2421a42e49368 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e49361 expref: 17 pid: 22741 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584204.707941:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b43ea7be00/0xdab2421a42e49368 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e49361 expref: 17 pid: 22741 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584204.707953:0:22732:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98b418982e00/0xdab2421a42e494bf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584204.707961:0:22732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b418982e00/0xdab2421a42e494bf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584204.707974:0:22732:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b418982e00/0xdab2421a42e494bf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584204.707981:0:22732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b418982e00/0xdab2421a42e494bf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584204.707988:0:22732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98b418982e00/0xdab2421a42e494bf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584204.707994:0:22732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98b418982e00/0xdab2421a42e494bf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584204.708009:0:22732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982e00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584204.708014:0:22732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98b418982e00/0xdab2421a42e494bf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584204.708021:0:22732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98b418982e00/0xdab2421a42e494bf lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584204.708043:0:22732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98b418982e00/0xdab2421a42e494bf lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584204.708053:0:22732:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584204.708076:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437691180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:954867da-9a7c-4a17-b608-74c1de1cda93+16:3642:x1871271599242496:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584204.708083:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784584204.708236:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:954867da-9a7c-4a17-b608-74c1de1cda93:3642:1871271599242496:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784584204.708256:0:23901:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98b418982e00/0xdab2421a42e494bf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584204.708265:0:23901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98b418982e00/0xdab2421a42e494bf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584204.708271:0:23901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b418982e00/0xdab2421a42e494bf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584204.709754:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584205.294617:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784584206.125708:0:22744:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784584206.125716:0:22744:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b4049d6000 from 13 10000000:01000000:2.0:1784584206.125722:0:22744:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784584206.125780:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a000/0xdab2421a42e494c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584206.125792:0:22744:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a000/0xdab2421a42e494c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584206.125804:0:22744:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a000/0xdab2421a42e494c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584206.125832:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437691c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599242624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784584206.125905:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584206.126125:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b407dc9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784584206.126302:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599242624 00000100:00100000:0.0:1784584206.126310:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599242624 00000100:00100000:0.0:1784584206.126421:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784584206.126432:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43fe8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+16:22744:x1871271599242624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584206.126446:0:22741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584206.126459:0:22741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b4332b8a00/0xdab2421a42e494cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e494c6 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584206.126529:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4332b8a00/0xdab2421a42e494cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e494c6 expref: 17 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584206.126539:0:22741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b4332b8a00/0xdab2421a42e494cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e494c6 expref: 17 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584206.126561:0:22741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b8a00, rc 0) 00000100:00100000:0.0:1784584206.126606:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43fe8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+17:22744:x1871271599242624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584206.126613:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784584206.126738:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437691c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599242624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784584206.126770:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a000/0xdab2421a42e494c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e494cd expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584206.126779:0:22744:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a000/0xdab2421a42e494c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e494cd expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584206.126842:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437691c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599242752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784584206.126868:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584206.127335:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b407dc9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584206.127408:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599242752 00000100:00100000:3.0:1784584206.127413:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599242752 00000100:00100000:0.0:1784584206.127611:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784584206.127618:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43fe8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+17:22744:x1871271599242752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784584206.128533:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43fe8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+17:22744:x1871271599242752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 913us (1661us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584206.128543:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784584206.128815:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437691c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599242752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784584206.128858:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437691c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599242880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784584206.128906:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584206.129134:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b407dc9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784584206.129172:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599242880 00000100:00100000:0.0:1784584206.129177:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599242880 00000100:00100000:0.0:1784584206.129374:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784584206.129384:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43fe8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+17:22744:x1871271599242880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784584206.129566:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43fe8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+17:22744:x1871271599242880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 183us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584206.129573:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784584206.129837:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437691c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599242880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784584206.131226:0:23969:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1784584206.131732:0:22744:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1784584206.131815:0:22744:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784584206.131828:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a000/0xdab2421a42e494c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e494cd expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584206.131839:0:22744:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a000/0xdab2421a42e494c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e494cd expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584206.131850:0:22744:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784584206.131853:0:22744:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b405f11000 from 13 10000000:01000000:2.0:1784584206.131856:0:22744:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784584206.131892:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ac00/0xdab2421a42e494d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584206.131901:0:22744:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ac00/0xdab2421a42e494d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584206.131924:0:22744:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ac00/0xdab2421a42e494d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584206.132125:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437693480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599243008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784584206.132193:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584206.132283:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b407dc9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784584206.132333:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599243008 00000100:00100000:1.0:1784584206.132341:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599243008 00000100:00100000:1.0:1784584206.132761:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784584206.132774:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43fe8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+17:22744:x1871271599243008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784584206.132790:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584206.132808:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b303b1c200/0xdab2421a42e494db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e494d4 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584206.132836:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b303b1c200/0xdab2421a42e494db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e494d4 expref: 18 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584206.132846:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b303b1c200/0xdab2421a42e494db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e494d4 expref: 18 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584206.132855:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1c200, rc 0) 00000100:00100000:1.0:1784584206.132919:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43fe8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+18:22744:x1871271599243008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584206.132926:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784584206.133005:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437693480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599243008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784584206.133028:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ac00/0xdab2421a42e494d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e494db expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584206.133037:0:22744:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ac00/0xdab2421a42e494d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e494db expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584206.133104:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599243136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784584206.133133:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584206.133459:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1784584206.133587:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599243136 00000100:00100000:2.0:1784584206.133592:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599243136 00000100:00100000:2.0:1784584206.133620:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784584206.133627:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43fe8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+18:22744:x1871271599243136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784584206.133909:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43fe8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+18:22744:x1871271599243136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 282us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584206.133916:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784584206.134002:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599243136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784584206.134044:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599243264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784584206.134086:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584206.134112:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1784584206.134264:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599243264 00000100:00100000:2.0:1784584206.134268:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599243264 00000100:00100000:2.0:1784584206.134291:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784584206.134296:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43fe8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+18:22744:x1871271599243264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784584206.134376:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43fe8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+18:22744:x1871271599243264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584206.134382:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784584206.134456:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599243264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784584206.135641:0:23970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1784584206.136175:0:22744:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1784584206.136220:0:22744:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784584206.136231:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ac00/0xdab2421a42e494d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e494db expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584206.136242:0:22744:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ac00/0xdab2421a42e494d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e494db expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584206.320036:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584207.026073:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784584197/real 1784584197] req@ffff98b43c8ec380 x1871271599237504/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584207 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584207.026102:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98b43c8ec380 x1871271599237504/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584207 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584207.026111:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784584197/real 1784584197] req@ffff98b43c8ef800 x1871271599237376/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584207 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584207.026121:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98b43c8ef800 x1871271599237376/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584207 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784584207.026138:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43e810800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784584207.026147:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1784584207.026151:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599237504:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1784584207.026156:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43e817000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784584207.026160:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1784584207.026162:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599237376:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1784584207.038441:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:954867da-9a7c-4a17-b608-74c1de1cda93:3639:1871271599243392:0@lo:400:kworker.0 00000100:00100000:0.0:1784584207.038542:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784584207.038614:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784584207.038619:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784584207.038622:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784584207.038624:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784584207.038648:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599243520:0@lo:400:kworker.0 00000100:00100000:0.0:1784584207.038677:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584207.038715:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599243520 00000100:00100000:0.0:1784584207.038722:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599243520 00000100:00100000:0.0:1784584207.038769:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784584207.038777:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1871271599243520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584207.038829:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1871271599243520:12345-0@lo:400:kworker.0 Request processed in 53us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584207.038836:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784584207.038870:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599243520:0@lo:400:kworker.0 00000100:00080000:0.0:1784584207.038911:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784584207.038915:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1784584207.038918:0:38:0:(import.c:65:import_set_state_nolock()) ffff98b43e817000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784584207.038922:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 640 00000100:00080000:0.0:1784584207.038926:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784584207.038931:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff98b43e817000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:0.0:1784584207.038949:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b43c8ec380 x1871271599243904/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784584207.038964:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784584207.038967:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1784584207.038969:0:38:0:(import.c:65:import_set_state_nolock()) ffff98b43e810800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784584207.038973:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 640 00000100:00080000:0.0:1784584207.038975:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784584207.038979:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98b43e810800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:0.0:1784584207.038988:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599243904:0@lo:8:kworker.0 00000400:00000100:0.0:1784584207.039020:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871271599243904 offset 0 length 520: 4 00000100:00100000:0.0:1784584207.039050:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b43c8ece00 x1871271599244032/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784584207.039069:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599244032:0@lo:8:kworker.0 00000400:00000100:0.0:1784584207.039088:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871271599244032 offset 0 length 520: 4 00000100:00100000:0.0:1784584207.039124:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599244160:0@lo:400:kworker.0 00000100:00100000:0.0:1784584207.039147:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584207.039191:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599244160 00000100:00100000:0.0:1784584207.039196:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599244160 00000100:00100000:0.0:1784584207.039225:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784584207.039232:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599244160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584207.039266:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599244160:12345-0@lo:400:kworker.0 Request processed in 36us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584207.039273:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1784584207.039300:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98b43c8edc00 x1871271599244160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584207.039310:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599244160:0@lo:400:kworker.0 00000100:00100000:2.0:1784584207.040707:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599243392 00000100:00100000:2.0:1784584207.040715:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599243392 00000100:00100000:2.0:1784584207.040752:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784584207.040759:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43fe8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+18:3639:x1871271599243392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584207.040823:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43fe8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+18:3639:x1871271599243392:12345-0@lo:400:kworker.0 Request processed in 64us (2281us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584207.040837:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784584207.040873:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599243648:0@lo:400:kworker.0 00000100:00100000:2.0:1784584207.040901:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584207.040931:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784584207.040937:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599243776:0@lo:400:kworker.0 00000100:00100000:2.0:1784584207.040961:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584207.041085:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:954867da-9a7c-4a17-b608-74c1de1cda93:3639:1871271599243392:0@lo:400:kworker.0 00000100:00100000:2.0:1784584207.041103:0:23818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599243776 00000100:00100000:2.0:1784584207.041106:0:23818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599243776 00000100:00100000:2.0:1784584207.041126:0:23818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784584207.041131:0:23818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599243776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584207.041161:0:23818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599243776:12345-0@lo:400:kworker.0 Request processed in 30us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584207.041166:0:23818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784584207.041651:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599243776:0@lo:400:kworker.0 00000100:00100000:1.0:1784584207.042459:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599243648 00000100:00100000:1.0:1784584207.042488:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599243648 00000100:00100000:1.0:1784584207.042533:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784584207.042540:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599243648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584207.042595:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599243648:12345-0@lo:400:kworker.0 Request processed in 55us (1693us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584207.042601:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1784584207.043161:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98b43c8ec000 x1871271599243648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584207.043174:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599243648:0@lo:400:kworker.0 00010000:00010000:1.0:1784584207.341643:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784584207.798733:0:22782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1784584208.047245:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599244288:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784584208.047317:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584208.047372:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599244288 00000100:00100000:3.0:1784584208.047380:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599244288 00000100:00100000:3.0:1784584208.047432:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784584208.047444:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1871271599244288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784584208.047515:0:22753:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1784584208.047561:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1871271599244288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584208.047570:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784584208.047618:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599244288:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784584208.048344:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784584208.048396:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599244416:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784584208.048449:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584208.048515:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599244416 00000100:00100000:3.0:1784584208.048521:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599244416 00000100:00100000:3.0:1784584208.048552:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784584208.048560:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41ea25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599244416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784584208.048584:0:22752:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1784584208.048624:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41ea25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599244416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584208.048632:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784584208.048666:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599244416:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1784584208.368086:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784584208.560532:0:23481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:3.0:1784584209.006292:0:23502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784584209.389621:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584210.094258:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784584195/real 1784584195] req@ffff98b43c8ef100 x1871271599235328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584210 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584210.094293:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98b43c8ef100 x1871271599235328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584210 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584210.094305:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784584195/real 1784584195] req@ffff98b43c8ee680 x1871271599235456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584210 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584210.094316:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98b43c8ee680 x1871271599235456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584210 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784584210.094334:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b416bde800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784584210.094356:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1784584210.094360:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599235328:0@lo:8:kworker.0 00000100:00080000:1.0:1784584210.094365:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b3041fd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784584210.094370:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1784584210.094373:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599235456:0@lo:8:kworker.0 00000100:00080000:2.0:1784584210.094462:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584210.094495:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1784584210.094497:0:38:0:(import.c:65:import_set_state_nolock()) ffff98b416bde800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784584210.094503:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 638 00000100:00080000:2.0:1784584210.094507:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784584210.094514:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98b416bde800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784584210.094534:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b437690380 x1871271599244800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784584210.094718:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584210.094721:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784584210.094723:0:38:0:(import.c:65:import_set_state_nolock()) ffff98b3041fd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784584210.094726:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 638 00000100:00080000:2.0:1784584210.094729:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784584210.094732:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98b3041fd000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784584210.094745:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b437690a80 x1871271599244928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784584210.094758:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:2.0:1784584210.094771:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:3.0:1784584210.094776:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599245056:0@lo:400:kworker.0 00000100:00080000:2.0:1784584210.094777:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784584210.094782:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584210.094787:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784584210.094816:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599245184:0@lo:400:kworker.0 00000100:00100000:3.0:1784584210.094849:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584210.094858:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584210.094890:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784584210.094893:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599244672:0@lo:400:kworker.0 00000100:00100000:2.0:1784584210.094899:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:954867da-9a7c-4a17-b608-74c1de1cda93:3641:1871271599244544:0@lo:400:kworker.0 00000100:00100000:3.0:1784584210.094928:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584210.094996:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599244800:0@lo:8:kworker.0 00000100:00100000:0.0:1784584210.095538:0:23818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599245184 00000100:00100000:0.0:1784584210.095547:0:23818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599245184 00000100:00100000:0.0:1784584210.095589:0:23818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599244672 00000100:00100000:0.0:1784584210.095601:0:23818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599244672 00000100:00100000:0.0:1784584210.095621:0:23818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784584210.095629:0:23818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599245184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584210.096899:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784584210.096914:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41ea24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599244672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584210.096940:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584210.097106:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599245312:0@lo:400:kworker.0 00000100:00100000:2.0:1784584210.097139:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584210.097204:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41ea24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599244672:12345-0@lo:400:kworker.0 Request processed in 295us (2274us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584210.097213:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784584210.097273:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599244672:0@lo:400:kworker.0 00000400:00000100:1.0:1784584210.097377:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871271599244800 offset 0 length 520: 4 00000100:00100000:1.0:1784584210.097398:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599244928:0@lo:8:kworker.0 00000400:00000100:1.0:1784584210.097447:0:3638:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871271599244928 offset 0 length 520: 4 00000100:00100000:0.0:1784584210.098340:0:23818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599245184:12345-0@lo:400:kworker.0 Request processed in 2708us (3479us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584210.098351:0:23818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784584210.098383:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599245056 00000100:00100000:0.0:1784584210.098391:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599245056 00000100:00100000:0.0:1784584210.098429:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599245312 00000100:00100000:0.0:1784584210.098433:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599245312 00000100:00100000:0.0:1784584210.098455:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784584210.098462:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41ea27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599245056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584210.098533:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41ea27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599245056:12345-0@lo:400:kworker.0 Request processed in 71us (3685us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584210.098540:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784584210.098551:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784584210.098557:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599245312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584210.098584:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599245312:12345-0@lo:400:kworker.0 Request processed in 27us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584210.098590:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784584210.098698:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599244544 00000100:00100000:0.0:1784584210.098702:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599244544 00000100:00100000:0.0:1784584210.098730:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784584210.098736:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43fe8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+18:3641:x1871271599244544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584210.098768:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43fe8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+18:3641:x1871271599244544:12345-0@lo:400:kworker.0 Request processed in 33us (1839us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584210.098776:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1784584210.098935:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98b437692680 x1871271599245056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584210.098959:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599245056:0@lo:400:kworker.0 00000100:00100000:2.0:1784584210.099275:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:954867da-9a7c-4a17-b608-74c1de1cda93:3641:1871271599244544:0@lo:400:kworker.0 00010000:00080000:2.0:1784584210.099289:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98b437692d80 x1871271599245312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584210.099309:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599245312:0@lo:400:kworker.0 00000100:00100000:2.0:1784584210.099322:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599245184:0@lo:400:kworker.0 00010000:00010000:0.0:1784584210.418720:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784584210.513423:0:24249:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1784584210.513428:0:24249:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1784584210.513429:0:24249:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1784584210.513654:0:24249:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff98b41073b800 00000020:01000004:1.0:1784584210.513671:0:24249:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1784584210.513690:0:24249:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1784584210.513704:0:24249:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff98b4331e4d40) 00000020:00000080:1.0:1784584210.513720:0:24249:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1784584210.570022:0:24249:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1784584210.576412:0:24249:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1784584210.576964:0:24249:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1784584210.578448:0:24249:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1784584210.579925:0:24249:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1784584210.580389:0:24249:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1784584210.580869:0:24249:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1784584210.584091:0:24249:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1784584210.584458:0:24249:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1784584210.584605:0:24249:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784584210.584621:0:24249:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdab2421a42e494e9 00000020:01000004:3.0:1784584210.584629:0:24249:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1784584210.584650:0:24249:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.151@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1784584210.584653:0:24249:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1784584210.584659:0:24249:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1784584210.584664:0:24249:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1784584210.584677:0:24249:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff98b42e933380) 00000020:00000080:3.0:1784584210.584688:0:24249:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1784584210.586357:0:24249:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784584210.586563:0:24249:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1784584210.586570:0:24249:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1784584210.589038:0:24249:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1784584210.589050:0:24249:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1784584210.592037:0:24249:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1784584210.592049:0:24249:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1784584210.596662:0:24249:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784584210.596877:0:24249:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1784584210.596883:0:24249:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1784584210.610755:0:24249:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1784584210.610775:0:24249:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1784584210.643387:0:24249:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784584210.643718:0:24249:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1784584210.643724:0:24249:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1784584210.645895:0:24249:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1784584210.645912:0:24249:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1784584210.647068:0:24249:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1784584210.647079:0:24249:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1784584210.649991:0:24249:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784584210.650168:0:24249:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1784584210.650174:0:24249:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1784584210.651042:0:24249:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1784584210.651052:0:24249:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1784584210.707024:0:24249:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784584210.707203:0:24249:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1784584210.707210:0:24249:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1784584210.709058:0:24249:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1784584210.709069:0:24249:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1784584210.717688:0:24249:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1784584210.717717:0:24249:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1784584210.717723:0:24249:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.151@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1784584210.730430:0:24249:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.151@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784584210.730520:0:24249:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.151@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1784584210.730526:0:24249:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784584210.730528:0:24249:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784584210.730529:0:24249:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784584210.730530:0:24249:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784584210.730532:0:24249:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784584210.730533:0:24249:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784584210.730534:0:24249:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784584210.730536:0:24249:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784584210.730538:0:24249:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784584210.730542:0:24249:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1784584210.730544:0:24249:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784584210.730551:0:24249:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784584210.730552:0:24249:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784584210.730553:0:24249:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784584210.730554:0:24249:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784584210.730555:0:24249:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784584210.730556:0:24249:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784584210.730557:0:24249:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784584210.730558:0:24249:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784584210.730592:0:24249:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1784584210.730611:0:24249:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b41ea26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599245440:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784584210.730677:0:24249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584210.730723:0:24249:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b410ccb240 going to sleep for 11 seconds 00000100:00100000:2.0:1784584210.731057:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599245440 00000100:00100000:2.0:1784584210.731064:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599245440 00000100:00100000:2.0:1784584210.731122:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784584210.731131:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+18:24249:x1871271599245440:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784584210.731159:0:22740:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1784584210.731162:0:22740:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1784584210.731166:0:22740:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1784584210.731453:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+18:24249:x1871271599245440:12345-0@lo:253:mount.lustre.0 Request processed in 322us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584210.731460:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784584210.731644:0:24249:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b41ea26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599245440:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784584210.731654:0:24249:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1784584210.731656:0:24249:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784584210.731657:0:24249:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784584210.731659:0:24249:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784584210.731660:0:24249:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784584210.731661:0:24249:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784584210.731662:0:24249:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784584210.731663:0:24249:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784584210.731665:0:24249:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784584210.731666:0:24249:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784584210.731684:0:24249:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98b41073b800 from lustre-OST0000 10000000:01000000:3.0:1784584210.731706:0:24249:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1784584210.731709:0:24249:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1784584210.731716:0:24249:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98b302bf0000 local copy 00010000:00010000:3.0:1784584210.731726:0:24249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418983600/0xdab2421a42e492a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e492ab expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584210.732102:0:24249:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b41ea26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599245568:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784584210.732139:0:24249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584210.732172:0:24249:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b418129a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784584210.732347:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599245568 00000100:00100000:2.0:1784584210.732353:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599245568 00000100:00100000:2.0:1784584210.732401:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784584210.732409:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+18:24249:x1871271599245568:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584210.732511:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+18:24249:x1871271599245568:12345-0@lo:501:mount.lustre.0 Request processed in 102us (371us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784584210.732518:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784584210.732649:0:24249:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b41ea26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599245568:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1784584210.732667:0:24249:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784584210.732687:0:24249:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784584210.732695:0:24249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418983600/0xdab2421a42e492a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e492ab expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584210.732704:0:24249:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b418983600/0xdab2421a42e492a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e492ab expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584210.732730:0:24249:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98b41073b800 10000000:01000000:3.0:1784584210.732734:0:24249:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784584210.732739:0:24249:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1784584210.732741:0:24249:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784584210.732745:0:24249:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1784584210.732748:0:24249:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784584210.732771:0:24249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982a00/0xdab2421a42e494f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584210.732780:0:24249:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b418982a00/0xdab2421a42e494f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584210.732789:0:24249:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b418982a00/0xdab2421a42e494f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584210.732803:0:24249:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b41ea26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599245696:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784584210.733653:0:24249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584210.733740:0:24249:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b418129a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784584210.736393:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599245696 00000100:00100000:1.0:1784584210.736408:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599245696 00000100:00100000:1.0:1784584210.736967:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1784584210.736980:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+18:24249:x1871271599245696:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784584210.736998:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584210.737016:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b303b1dc00/0xdab2421a42e494fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e494f7 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.737043:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b303b1dc00/0xdab2421a42e494fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e494f7 expref: 19 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.737054:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b303b1dc00/0xdab2421a42e494fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e494f7 expref: 19 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.737063:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1dc00, rc 0) 00000100:00100000:1.0:1784584210.737502:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+19:24249:x1871271599245696:12345-0@lo:101:mount.lustre.0 Request processed in 523us (3849us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584210.737510:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784584210.739894:0:24249:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b41ea26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599245696:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784584210.739921:0:24249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b418982a00/0xdab2421a42e494f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e494fe expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584210.739951:0:24249:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b418982a00/0xdab2421a42e494f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e494fe expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784584210.742175:0:24249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:3.0:1784584210.742893:0:24249:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784584210.745333:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1784584210.745392:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1784584210.745409:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1784584210.745424:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1784584210.745436:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1784584210.745449:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1784584210.745463:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1784584210.745776:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1784584210.745793:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1784584210.745808:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1784584210.745940:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1784584210.745963:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1784584210.745991:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1784584210.745998:0:24249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:3.0:1784584210.746117:0:24249:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b41ea26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599245824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784584210.746184:0:24249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584210.746303:0:24249:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b418129180 going to sleep for 11 seconds 00000100:00100000:1.0:1784584210.748792:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599245824 00000100:00100000:1.0:1784584210.748806:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599245824 00000100:00100000:1.0:1784584210.749175:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784584210.749187:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+19:24249:x1871271599245824:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584210.749401:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+19:24249:x1871271599245824:12345-0@lo:501:mount.lustre.0 Request processed in 217us (3216us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584210.749409:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784584210.749533:0:24249:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b41ea26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599245824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784584210.749581:0:24249:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b41ea26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599245952:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784584210.749633:0:24249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584210.749992:0:24249:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b418129180 going to sleep for 11 seconds 00000100:00100000:2.0:1784584210.750089:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599245952 00000100:00100000:2.0:1784584210.750096:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599245952 00000100:00100000:0.0:1784584210.750322:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784584210.750331:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+19:24249:x1871271599245952:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784584210.756736:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+19:24249:x1871271599245952:12345-0@lo:503:mount.lustre.0 Request processed in 6396us (7093us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584210.756751:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784584210.757390:0:24249:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b41ea26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599245952:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784584210.757976:0:24249:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784584210.758068:0:24249:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b41ea26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599246080:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584210.758122:0:24249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584210.758152:0:24249:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b404d0be40 going to sleep for 11 seconds 00000100:00100000:0.0:1784584210.758531:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599246080 00000100:00100000:0.0:1784584210.758538:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599246080 00000100:00100000:0.0:1784584210.758590:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784584210.758599:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+19:24249:x1871271599246080:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784584210.759156:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+19:24249:x1871271599246080:12345-0@lo:502:mount.lustre.0 Request processed in 557us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584210.759165:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784584210.761440:0:24249:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b41ea26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599246080:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784584210.761726:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1784584210.761769:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1784584210.761781:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1784584210.761792:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1784584210.761804:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1784584210.761816:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1784584210.762315:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1784584210.762337:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1784584210.762348:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1784584210.762358:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1784584210.762367:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1784584210.762380:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1784584210.762418:0:24249:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b41ea26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599246208:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584210.762579:0:24249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584210.762658:0:24249:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b418129a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784584210.765404:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599246208 00000100:00100000:0.0:1784584210.765419:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599246208 00000100:00100000:0.0:1784584210.765653:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784584210.765665:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+19:24249:x1871271599246208:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784584210.765857:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+19:24249:x1871271599246208:12345-0@lo:502:mount.lustre.0 Request processed in 194us (3277us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584210.765865:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784584210.765951:0:24249:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b41ea26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599246208:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784584210.766029:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1784584210.766043:0:24249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1784584210.767198:0:24266:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784584210.767208:0:24266:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1784584210.767214:0:24266:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584210.767216:0:24266:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1784584210.767222:0:24266:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784584210.767256:0:24266:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff98b43408cd40) 00000020:00000080:3.0:1784584210.767282:0:24266:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1784584210.767289:0:24266:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784584210.767374:0:24266:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98b41073b800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1784584210.767383:0:24266:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784584210.767390:0:24266:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdab2421a42e4950c 00010000:00010000:2.0:1784584210.777150:0:24266:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1784584210.783018:0:24266:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:2.0:1784584210.785899:0:24266:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1784584210.788129:0:24266:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1784584210.788141:0:24266:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584210.788147:0:24266:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584210.788149:0:24266:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1784584210.788153:0:24266:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784584210.788155:0:24266:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1784584210.788157:0:24266:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784584210.788158:0:24266:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784584210.788160:0:24266:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784584210.788162:0:24266:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584210.788163:0:24266:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784584210.788166:0:24266:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584210.788169:0:24266:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584210.788170:0:24266:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784584210.788173:0:24266:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784584210.788175:0:24266:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784584210.788177:0:24266:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584210.788180:0:24266:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584210.788181:0:24266:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1784584210.788183:0:24266:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584210.788185:0:24266:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584210.788186:0:24266:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784584210.788200:0:24266:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1784584210.788226:0:24266:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584210.788228:0:24266:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584210.788230:0:24266:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784584210.788232:0:24266:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:3.0:1784584210.793141:0:24249:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1784584210.793187:0:24249:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784584210.793208:0:24249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982a00/0xdab2421a42e494f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e494fe expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584210.793221:0:24249:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b418982a00/0xdab2421a42e494f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e494fe expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584210.793230:0:24249:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b41073b800 from 1 10000000:01000000:3.0:1784584210.793233:0:24249:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784584210.793287:0:24249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e49513 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584210.793296:0:24249:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e49513 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584210.793307:0:24249:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e49513 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584210.793332:0:24249:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b41ea26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599246336:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784584210.793402:0:24249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584210.793453:0:24249:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b418129180 going to sleep for 11 seconds 00000100:00100000:2.0:1784584210.793658:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599246336 00000100:00100000:2.0:1784584210.793666:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599246336 00000100:00100000:2.0:1784584210.793721:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784584210.793731:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+19:24249:x1871271599246336:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784584210.793744:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584210.793756:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ea7aa00/0xdab2421a42e4951a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e49513 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584210.793779:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ea7aa00/0xdab2421a42e4951a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e49513 expref: 20 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584210.793790:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ea7aa00/0xdab2421a42e4951a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e49513 expref: 20 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584210.793799:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7aa00, rc 0) 00000100:00100000:2.0:1784584210.793855:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+20:24249:x1871271599246336:12345-0@lo:101:mount.lustre.0 Request processed in 126us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584210.793863:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784584210.794343:0:24249:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b41ea26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599246336:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784584210.794359:0:24249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e49513 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4951a expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584210.794381:0:24249:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e49513 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e4951a expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784584210.796152:0:24249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1784584210.796419:0:24249:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784584210.796737:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1784584210.796765:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1784584210.796781:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1784584210.796795:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1784584210.796808:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1784584210.796822:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1784584210.796904:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1784584210.796919:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1784584210.796933:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1784584210.796948:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1784584210.796962:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1784584210.796996:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1784584210.797004:0:24249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1784584210.797074:0:24249:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b41ea26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599246464:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784584210.797131:0:24249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584210.797215:0:24249:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b418129c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784584210.801419:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599246464 00000100:00100000:0.0:1784584210.801431:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599246464 00000100:00100000:0.0:1784584210.801511:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784584210.801521:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+20:24249:x1871271599246464:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784584210.801669:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+20:24249:x1871271599246464:12345-0@lo:501:mount.lustre.0 Request processed in 150us (4537us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584210.801676:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784584210.802172:0:24249:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b41ea26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599246464:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784584210.802219:0:24249:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b41ea26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599246592:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784584210.802273:0:24249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584210.802322:0:24249:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b418129c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784584210.802376:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599246592 00000100:00100000:0.0:1784584210.802381:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599246592 00000100:00100000:0.0:1784584210.802406:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784584210.802411:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+20:24249:x1871271599246592:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784584210.802526:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+20:24249:x1871271599246592:12345-0@lo:503:mount.lustre.0 Request processed in 113us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584210.802532:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784584210.803552:0:24249:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b41ea26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599246592:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784584210.805424:0:24249:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784584210.805595:0:24249:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b41ea26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599246720:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584210.805667:0:24249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584210.805754:0:24249:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40674c540 going to sleep for 11 seconds 00000100:00100000:0.0:1784584210.805914:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599246720 00000100:00100000:0.0:1784584210.805920:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599246720 00000100:00100000:0.0:1784584210.806007:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784584210.806018:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+20:24249:x1871271599246720:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784584210.806131:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+20:24249:x1871271599246720:12345-0@lo:502:mount.lustre.0 Request processed in 114us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584210.806138:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784584210.806214:0:24249:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b41ea26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599246720:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784584210.806389:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1784584210.806415:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1784584210.806428:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1784584210.806439:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1784584210.806451:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1784584210.806462:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1784584210.806538:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1784584210.806551:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1784584210.806562:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1784584210.806572:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1784584210.806583:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1784584210.806602:0:24249:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b41ea26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599246848:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584210.806635:0:24249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584210.806785:0:24249:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b418129180 going to sleep for 11 seconds 00000100:00100000:2.0:1784584210.809977:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599246848 00000100:00100000:2.0:1784584210.809991:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599246848 00000100:00100000:2.0:1784584210.810046:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784584210.810055:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+20:24249:x1871271599246848:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784584210.810213:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+20:24249:x1871271599246848:12345-0@lo:502:mount.lustre.0 Request processed in 158us (3576us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584210.810229:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784584210.810583:0:24249:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b41ea26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599246848:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784584210.810665:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1784584210.810679:0:24249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1784584210.812627:0:24270:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584210.812636:0:24270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584210.812638:0:24270:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784584210.812644:0:24270:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98b41073b800 00000020:00000080:2.0:1784584210.812646:0:24270:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784584210.812652:0:24270:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584210.812654:0:24270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584210.812655:0:24270:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1784584210.812656:0:24270:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584210.812657:0:24270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584210.812658:0:24270:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784584210.812660:0:24270:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98b41073b800 00000020:00000080:2.0:1784584210.812661:0:24270:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784584210.812712:0:24270:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584210.812714:0:24270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584210.812715:0:24270:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1784584210.812717:0:24270:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584210.812719:0:24270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584210.812721:0:24270:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784584210.812724:0:24270:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98b41073b800 00000020:00000080:2.0:1784584210.812726:0:24270:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784584210.812751:0:24270:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584210.812759:0:24270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584210.812760:0:24270:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784584210.812763:0:24270:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584210.812766:0:24270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584210.812767:0:24270:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1784584210.812779:0:24270:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98b41073b800 00000020:00000080:2.0:1784584210.812782:0:24270:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784584210.812807:0:24270:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584210.812811:0:24270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584210.812812:0:24270:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1784584210.812815:0:24270:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1784584210.814141:0:24249:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1784584210.814180:0:24249:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784584210.814206:0:24249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e49513 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4951a expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.814220:0:24249:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e49513 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4951a expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584210.814286:0:24249:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784584210.814289:0:24249:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98b41073b800 10000000:01000000:1.0:1784584210.814292:0:24249:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98b41073b800 10000000:01000000:1.0:1784584210.814296:0:24249:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784584210.814311:0:24249:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98b41073b800 from 1 10000000:01000000:1.0:1784584210.814314:0:24249:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784584210.814352:0:24249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e49521 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.814360:0:24249:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e49521 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.814371:0:24249:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e49521 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584210.814403:0:24249:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599246976:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784584210.814496:0:24249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584210.814532:0:24249:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb32240 going to sleep for 11 seconds 00000100:00100000:2.0:1784584210.815961:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599246976 00000100:00100000:2.0:1784584210.815972:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599246976 00000100:00100000:2.0:1784584210.816026:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784584210.816037:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+20:24249:x1871271599246976:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784584210.816054:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584210.816070:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ea7a200/0xdab2421a42e49528 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e49521 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584210.816096:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ea7a200/0xdab2421a42e49528 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e49521 expref: 21 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584210.816107:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ea7a200/0xdab2421a42e49528 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e49521 expref: 21 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584210.816115:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7a200, rc 0) 00000100:00100000:2.0:1784584210.816185:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+21:24249:x1871271599246976:12345-0@lo:101:mount.lustre.0 Request processed in 150us (1688us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584210.816191:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784584210.817028:0:24249:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599246976:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784584210.817048:0:24249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e49521 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e49528 expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.817056:0:24249:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e49521 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e49528 expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784584210.825639:0:24249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1784584210.826072:0:24249:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784584210.826407:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1784584210.826431:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1784584210.826443:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1784584210.826454:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1784584210.826494:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1784584210.826512:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1784584210.826525:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1784584210.826536:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1784584210.826548:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1784584210.826559:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1784584210.826583:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1784584210.826598:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1784584210.826611:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1784584210.826624:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1784584210.826637:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1784584210.826651:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1784584210.826664:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1784584210.826689:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1784584210.826703:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1784584210.826717:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1784584210.826730:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1784584210.826743:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1784584210.826757:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1784584210.826771:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1784584210.826784:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1784584210.826798:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1784584210.827758:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1784584210.827780:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1784584210.827795:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1784584210.827820:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1784584210.827903:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1784584210.827917:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1784584210.827930:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1784584210.827944:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1784584210.827957:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1784584210.827970:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1784584210.827983:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1784584210.827996:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1784584210.828007:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1784584210.828020:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1784584210.828033:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1784584210.828046:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1784584210.828074:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1784584210.828090:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1784584210.828102:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1784584210.828114:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1784584210.828126:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1784584210.828139:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1784584210.829074:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1784584210.829105:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1784584210.829133:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1784584210.829137:0:24249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1784584210.829233:0:24249:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599247104:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584210.830507:0:24249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584210.830543:0:24249:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb32f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784584210.833133:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599247104 00000100:00100000:3.0:1784584210.833146:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599247104 00000100:00100000:3.0:1784584210.833200:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784584210.833211:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+21:24249:x1871271599247104:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784584210.833413:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+21:24249:x1871271599247104:12345-0@lo:501:mount.lustre.0 Request processed in 204us (2907us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584210.833421:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784584210.833521:0:24249:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599247104:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584210.833573:0:24249:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599247232:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784584210.833722:0:24249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584210.833767:0:24249:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb32f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784584210.833771:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599247232 00000100:00100000:3.0:1784584210.833776:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599247232 00000100:00100000:3.0:1784584210.833802:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784584210.833809:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+21:24249:x1871271599247232:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784584210.833912:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+21:24249:x1871271599247232:12345-0@lo:503:mount.lustre.0 Request processed in 103us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584210.833918:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1784584210.834065:0:24249:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599247232:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784584210.834690:0:24249:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784584210.834759:0:24249:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599247360:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784584210.834802:0:24249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584210.834827:0:24249:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb32240 going to sleep for 11 seconds 00000100:00100000:3.0:1784584210.835884:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599247360 00000100:00100000:3.0:1784584210.835895:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599247360 00000100:00100000:3.0:1784584210.835938:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784584210.835947:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+21:24249:x1871271599247360:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584210.836067:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+21:24249:x1871271599247360:12345-0@lo:502:mount.lustre.0 Request processed in 121us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584210.836075:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784584210.836116:0:24249:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599247360:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784584210.836525:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1784584210.836555:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1784584210.836570:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1784584210.836584:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1784584210.836615:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1784584210.836632:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1784584210.836645:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1784584210.836658:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1784584210.836670:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1784584210.836681:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1784584210.836693:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1784584210.836707:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1784584210.836731:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1784584210.836758:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1784584210.836775:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1784584210.836787:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1784584210.836800:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1784584210.836834:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1784584210.836857:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1784584210.836870:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1784584210.836896:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1784584210.836913:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1784584210.836927:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1784584210.836940:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1784584210.836951:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1784584210.836963:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1784584210.836973:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1784584210.836985:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1784584210.836998:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1784584210.837010:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1784584210.837022:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1784584210.837034:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1784584210.837047:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1784584210.837060:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1784584210.837073:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1784584210.837086:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1784584210.837111:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1784584210.837125:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1784584210.837136:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1784584210.837149:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1784584210.837161:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1784584210.837174:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1784584210.837185:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1784584210.837197:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1784584210.837208:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1784584210.837229:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1784584210.837650:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1784584210.837669:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1784584210.837719:0:24249:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599247488:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784584210.837795:0:24249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584210.837952:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599247488 00000100:00100000:3.0:1784584210.837960:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599247488 00000100:00100000:3.0:1784584210.838002:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784584210.838012:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+21:24249:x1871271599247488:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784584210.838049:0:24249:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb32240 going to sleep for 11 seconds 00000100:00100000:3.0:1784584210.838127:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+21:24249:x1871271599247488:12345-0@lo:502:mount.lustre.0 Request processed in 116us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584210.838135:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1784584210.840683:0:24249:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599247488:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784584210.840914:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1784584210.840941:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1784584210.840976:0:24249:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599247616:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784584210.841040:0:24249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584210.841083:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599247616 00000100:00100000:1.0:1784584210.841084:0:24249:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb32240 going to sleep for 11 seconds 00000100:00100000:3.0:1784584210.841090:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599247616 00000100:00100000:3.0:1784584210.841139:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784584210.841149:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+21:24249:x1871271599247616:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584210.841267:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+21:24249:x1871271599247616:12345-0@lo:502:mount.lustre.0 Request processed in 119us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584210.841275:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1784584210.842882:0:24249:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599247616:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784584210.842956:0:24249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1784584210.842969:0:24249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1784584210.846082:0:24275:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1784584210.846101:0:24275:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff98b4071acd40) 00000020:00000080:2.0:1784584210.846130:0:24275:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1784584210.846325:0:24275:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98b41073b800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1784584210.846329:0:24275:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98b41073b800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1784584210.846332:0:24275:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b41073b800 3 00010000:00080000:2.0:1784584210.846367:0:24275:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b302b39800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.151@tcp at head 00010000:00010000:2.0:1784584210.849626:0:24275:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1784584210.849738:0:24275:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1784584210.849790:0:24275:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784584210.849806:0:24275:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xdab2421a42e49536 00000100:00080000:2.0:1784584210.849817:0:24275:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784584210.849824:0:24275:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98b302b39800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1784584210.849859:0:24275:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b437690700 x1871271599247744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784584210.849884:0:24275:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1784584210.849985:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1871271599247744:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784584210.850052:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1784584210.850574:0:24275:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1784584210.850589:0:24275:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff98b4340899c0) 00000020:00000080:3.0:1784584210.850610:0:24275:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1784584210.850730:0:24275:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98b41073b800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784584210.850734:0:24275:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98b41073b800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784584210.850737:0:24275:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b41073b800 3 00010000:00080000:3.0:1784584210.850762:0:24275:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b3026db800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.151@tcp at head 00000100:00080000:2.0:1784584210.852384:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584210.852391:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784584210.852394:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584210.852397:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784584210.852431:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584210.852435:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784584210.852437:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584210.852440:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784584210.852507:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599247872:0@lo:400:kworker.0 00000100:00100000:2.0:1784584210.852571:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584210.852607:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784584210.852614:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599248000:0@lo:400:kworker.0 00000100:00100000:2.0:1784584210.852647:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599248128:0@lo:400:kworker.0 00000100:00100000:2.0:1784584210.852681:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584210.852702:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784584210.852708:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b437692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599248256:0@lo:400:kworker.0 00000100:00100000:3.0:1784584210.853092:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599247872 00000100:00100000:3.0:1784584210.853100:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599247872 00000100:00100000:3.0:1784584210.853138:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599248128 00000100:00100000:3.0:1784584210.853140:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599248128 00000100:00100000:3.0:1784584210.853173:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784584210.853182:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599247872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584210.853253:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599247872:12345-0@lo:400:kworker.0 Request processed in 72us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584210.853261:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784584210.853277:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784584210.853285:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599248128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584210.853322:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599248128:12345-0@lo:400:kworker.0 Request processed in 38us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584210.853327:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:3.0:1784584210.855723:0:24275:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000100:00100000:1.0:1784584210.855770:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584210.855822:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599248128:0@lo:400:kworker.0 00000020:00000080:3.0:1784584210.855834:0:24275:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1784584210.855876:0:24275:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784584210.855888:0:24275:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xdab2421a42e49544 00000100:00080000:3.0:1784584210.855896:0:24275:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784584210.855901:0:24275:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff98b3026db800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:3.0:1784584210.855931:0:24275:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b41ea25c00 x1871271599248384/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784584210.855951:0:24275:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1784584210.855978:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599247744 00000100:00100000:0.0:1784584210.855986:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599247744 00000100:00100000:0.0:1784584210.856018:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599248256 00000100:00100000:0.0:1784584210.856021:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599248256 00000100:00100000:0.0:1784584210.856183:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784584210.856195:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599248256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584210.856267:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599248256:12345-0@lo:400:kworker.0 Request processed in 74us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584210.856275:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784584210.856294:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784584210.856299:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1871271599247744:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1784584210.856319:0:22748:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 654 last 0 00000020:00000080:0.0:1784584210.856351:0:22748:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xdab2421a42e4954b 00000004:00100000:0.0:1784584210.856365:0:22748:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784584210.856395:0:22748:0:(import.c:65:import_set_state_nolock()) ffff98b43e964800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784584210.856431:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1871271599247744:12345-0@lo:38:llog_process_th.0 Request processed in 130us (6379us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584210.856439:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784584210.856543:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584210.856572:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599247872:0@lo:400:kworker.0 00000100:00100000:0.0:1784584210.856594:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599248000 00000100:00100000:0.0:1784584210.856597:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599248000 00000100:00100000:0.0:1784584210.856625:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784584210.856633:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599248000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584210.856669:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599248000:12345-0@lo:400:kworker.0 Request processed in 37us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584210.856675:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1784584210.856704:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98b437693480 x1871271599248000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584210.856721:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599248000:0@lo:400:kworker.0 00010000:00080000:1.0:1784584210.856981:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98b437692680 x1871271599248256/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584210.856991:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599248256:0@lo:400:kworker.0 00000100:00100000:1.0:1784584210.857013:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b41ea25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1871271599248384:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784584210.857053:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1784584210.857127:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98b437690700 x1871271599247744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784584220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584210.857145:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784584210.857152:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1784584210.857159:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1784584210.857163:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1784584210.857165:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b302b39800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784584210.857170:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1871271599247744:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784584210.857218:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599248384 00000100:00100000:0.0:1784584210.857223:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599248384 00000100:00100000:0.0:1784584210.857279:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784584210.857284:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1871271599248384:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1784584210.857301:0:23817:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 654 last 0 00000020:00000080:0.0:1784584210.857329:0:23817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xdab2421a42e49552 00000004:00100000:0.0:1784584210.857340:0:23817:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784584210.857364:0:23817:0:(import.c:65:import_set_state_nolock()) ffff98b43ca67800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1784584210.857373:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784584210.857378:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784584210.857381:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784584210.857384:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784584210.857389:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784584210.857392:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784584210.857395:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784584210.857397:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784584210.857409:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1871271599248384:12345-0@lo:38:llog_process_th.0 Request processed in 122us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584210.857417:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1784584210.857462:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98b41ea25c00 x1871271599248384/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784584220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584210.857501:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784584210.857505:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1784584210.857510:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1784584210.857514:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1784584210.857516:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b3026db800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784584210.857520:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b41ea25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1871271599248384:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1784584210.858380:0:24275:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1784584210.858570:0:24249:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1784584210.858598:0:24249:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784584210.858619:0:24249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e49521 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e49528 expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.858630:0:24249:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b303b1cc00/0xdab2421a42e49521 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e49528 expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784584210.858676:0:24249:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784584210.858678:0:24249:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784584210.858684:0:24249:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784584210.858685:0:24249:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784584210.858686:0:24249:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784584210.858688:0:24249:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784584210.858689:0:24249:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784584210.858691:0:24249:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784584210.858692:0:24249:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784584210.858695:0:24249:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1784584210.858697:0:24249:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784584210.858699:0:24249:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784584210.858700:0:24249:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784584210.858701:0:24249:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784584210.858702:0:24249:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784584210.858703:0:24249:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784584210.858704:0:24249:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784584210.858705:0:24249:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784584210.858706:0:24249:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784584210.858728:0:24249:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1784584210.859068:0:24249:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efabb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599248512:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784584210.859120:0:24249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584210.859155:0:24249:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb32780 going to sleep for 11 seconds 00000100:00100000:0.0:1784584210.859528:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599248512 00000100:00100000:0.0:1784584210.859535:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599248512 00000100:00100000:0.0:1784584210.859580:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1784584210.859588:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+21:24249:x1871271599248512:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784584210.859624:0:22742:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1784584210.859637:0:22742:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1784584210.870418:0:22742:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784584210.870442:0:22742:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1784584210.870782:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+21:24249:x1871271599248512:12345-0@lo:253:mount.lustre.0 Request processed in 11190us (11656us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584210.870795:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 20000000:01000000:1.0:1784584210.871062:0:22763:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784584210.871076:0:22763:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784584210.871103:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98b303b1d400/0xdab2421a42e49559 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.871119:0:22763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b43ea7ba00/0xdab2421a42e494a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e4949c expref: 20 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.871131:0:22763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b43ea7b800/0xdab2421a42e494b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e494aa expref: 20 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.871137:0:22763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98b303b1d400/0xdab2421a42e49559 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.871172:0:22763:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b43ea7b800/0xdab2421a42e494b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e494aa expref: 20 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.871201:0:22763:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b43ea7b800/0xdab2421a42e494b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e494aa expref: 20 pid: 22740 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584210.871216:0:22763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efab480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22763:1871271599248640:0@lo:104: 00000100:00100000:1.0:1784584210.871254:0:22763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784584210.871293:0:22763:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b43ea7ba00/0xdab2421a42e494a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e4949c expref: 20 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.871301:0:22763:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b43ea7ba00/0xdab2421a42e494a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e4949c expref: 20 pid: 22741 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584210.871309:0:22763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22763:1871271599248768:0@lo:104: 00000100:00100000:1.0:1784584210.871331:0:22763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584210.871347:0:22763:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb32f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784584210.871370:0:22731:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784584210.871387:0:22731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599248640 00000100:00100000:1.0:1784584210.871393:0:22731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599248640 00000100:00100000:1.0:1784584210.871417:0:22731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599248768 00000100:00100000:1.0:1784584210.871419:0:22731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599248768 00000100:00100000:1.0:1784584210.871429:0:22731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784584210.871436:0:22731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:954867da-9a7c-4a17-b608-74c1de1cda93+4:22763:x1871271599248640:12345-0@lo:104: 00010000:00010000:1.0:1784584210.871447:0:22731:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b303b1c800/0xdab2421a42e494aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e494b1 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.871519:0:22731:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784584210.871524:0:22731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:954867da-9a7c-4a17-b608-74c1de1cda93+4:22763:x1871271599248640:12345-0@lo:104: Request processed in 89us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584210.871530:0:22731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784584210.871558:0:22731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784584210.871563:0:22731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43ff0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:954867da-9a7c-4a17-b608-74c1de1cda93+3:22763:x1871271599248768:12345-0@lo:104: 00010000:00010000:1.0:1784584210.871574:0:22731:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e4949c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e494a3 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.871608:0:22731:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784584210.871613:0:22731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43ff0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:954867da-9a7c-4a17-b608-74c1de1cda93+3:22763:x1871271599248768:12345-0@lo:104: Request processed in 50us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584210.871618:0:22731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784584210.871678:0:22763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efab480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22763:1871271599248640:0@lo:104: 00000100:00100000:0.0:1784584210.871687:0:22763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22763:1871271599248768:0@lo:104: 00010000:00010000:0.0:1784584210.871710:0:22763:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98b303b1d400/0xdab2421a42e49559 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.871960:0:22735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784584210.871966:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b303b1c800/0xdab2421a42e494aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e494b1 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.871978:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1c800 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:1.0:1784584210.871982:0:22735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b303b1c800/0xdab2421a42e494aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e494b1 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.871989:0:22735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b303b1c800/0xdab2421a42e494aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e494b1 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784584210.871997:0:22735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b303b1c800/0xdab2421a42e494aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e494b1 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584210.872003:0:22735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784584210.872922:0:22735:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b303b1c800/0xdab2421a42e494aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e494b1 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.872934:0:22735:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784584210.872956:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b303b1c800/0xdab2421a42e494aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e494b1 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.872977:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b303b1c800/0xdab2421a42e494aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e494b1 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.872991:0:22735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584210.872994:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e4949c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e494a3 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.873000:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982200 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:1.0:1784584210.873004:0:22735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e4949c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e494a3 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.873011:0:22735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e4949c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e494a3 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784584210.873017:0:22735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e4949c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e494a3 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584210.873021:0:22735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1784584210.873078:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:954867da-9a7c-4a17-b608-74c1de1cda93:3639:1871271599248896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784584210.873120:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584210.873170:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599248896 00000100:00100000:0.0:1784584210.873175:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599248896 00010000:00010000:0.0:1784584210.873196:0:22732:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b43ea7b800/0xdab2421a42e494b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e494aa expref: 21 pid: 22740 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584210.873218:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784584210.873225:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:954867da-9a7c-4a17-b608-74c1de1cda93+21:3639:x1871271599248896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784584210.873236:0:22732:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584210.873241:0:22732:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b43ea7b800/0xdab2421a42e494b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e494aa expref: 21 pid: 22740 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584210.873250:0:22732:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b43ea7b800/0xdab2421a42e494b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e494aa expref: 21 pid: 22740 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584210.873265:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b43ea7b800/0xdab2421a42e494b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e494aa expref: 21 pid: 22740 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584210.873277:0:22732:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584210.873306:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:954867da-9a7c-4a17-b608-74c1de1cda93+20:3639:x1871271599248896:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584210.873312:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784584210.873348:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:954867da-9a7c-4a17-b608-74c1de1cda93:3639:1871271599248896:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784584210.874571:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584210.874609:0:24249:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efabb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:24249:1871271599248512:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784584210.874625:0:24249:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1784584210.874628:0:24249:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784584210.874630:0:24249:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784584210.874632:0:24249:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784584210.874633:0:24249:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784584210.874635:0:24249:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784584210.874636:0:24249:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784584210.874637:0:24249:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784584210.874639:0:24249:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784584210.874640:0:24249:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1784584210.874653:0:24249:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1784584210.875634:0:22735:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e4949c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e494a3 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.875645:0:22735:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784584210.875670:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e4949c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e494a3 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.875678:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e4949c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e494a3 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.875694:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584210.875703:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584210.875704:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584210.875720:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:954867da-9a7c-4a17-b608-74c1de1cda93:3640:1871271599249024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784584210.875790:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584210.875857:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599249024 00000100:00100000:1.0:1784584210.875863:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599249024 00010000:00010000:1.0:1784584210.875886:0:22733:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b43ea7ba00/0xdab2421a42e494a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e4949c expref: 20 pid: 22741 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584210.875913:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784584210.875921:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c896050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:954867da-9a7c-4a17-b608-74c1de1cda93+20:3640:x1871271599249024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784584210.875931:0:22733:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584210.875936:0:22733:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b43ea7ba00/0xdab2421a42e494a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e4949c expref: 20 pid: 22741 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.875945:0:22733:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b43ea7ba00/0xdab2421a42e494a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e4949c expref: 20 pid: 22741 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.875958:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b43ea7ba00/0xdab2421a42e494a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e4949c expref: 20 pid: 22741 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.875971:0:22733:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98b303b1d400/0xdab2421a42e49559 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.875979:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b303b1d400/0xdab2421a42e49559 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784584210.875991:0:22733:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.018163401s 00010000:00010000:1.0:1784584210.875995:0:22733:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b303b1d400/0xdab2421a42e49559 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.876012:0:22733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b303b1d400/0xdab2421a42e49559 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.876018:0:22733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98b303b1d400/0xdab2421a42e49559 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.876024:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98b303b1d400/0xdab2421a42e49559 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.876031:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1d400 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:1.0:1784584210.876035:0:22733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98b303b1d400/0xdab2421a42e49559 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.876042:0:22733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98b303b1d400/0xdab2421a42e49559 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.876057:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98b303b1d400/0xdab2421a42e49559 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.876067:0:22733:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584210.876100:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c896050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:954867da-9a7c-4a17-b608-74c1de1cda93+19:3640:x1871271599249024:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584210.876107:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1784584210.876159:0:22763:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98b303b1d400/0xdab2421a42e49559 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.876167:0:22763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98b303b1d400/0xdab2421a42e49559 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584210.876174:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b303b1d400/0xdab2421a42e49559 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584210.876212:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:954867da-9a7c-4a17-b608-74c1de1cda93:3640:1871271599249024:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1784584210.881687:0:24249:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1784584210.886736:0:24249:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1784584210.887122:0:24249:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1784584210.887158:0:24249:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784584210.887195:0:24249:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.151@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784584210.887217:0:24249:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1784584210.887233:0:24249:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1784584210.891419:0:24249:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784584210.893303:0:24249:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784584211.440296:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784584211.802328:0:24329:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784584211.806438:0:24329:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1784584212.397701:0:22744:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784584212.397709:0:22744:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98b4049d6000 from 13 10000000:01000000:3.0:1784584212.397715:0:22744:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784584212.397766:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e49560 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584212.397782:0:22744:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e49560 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584212.397794:0:22744:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e49560 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584212.397821:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b41ea24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599249152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784584212.397887:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584212.398090:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41047f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784584212.399654:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599249152 00000100:00100000:0.0:1784584212.399667:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599249152 00000100:00100000:0.0:1784584212.399720:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1784584212.399729:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+19:22744:x1871271599249152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584212.399744:0:22741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584212.399761:0:22741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b4332b9200/0xdab2421a42e49567 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e49560 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584212.399798:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4332b9200/0xdab2421a42e49567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e49560 expref: 20 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584212.399808:0:22741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b4332b9200/0xdab2421a42e49567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e49560 expref: 20 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584212.399817:0:22741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b9200, rc 0) 00000100:00100000:0.0:1784584212.399955:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+20:22744:x1871271599249152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 227us (2067us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584212.399963:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784584212.401920:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b41ea24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599249152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784584212.401947:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e49560 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e49567 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584212.401958:0:22744:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e49560 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e49567 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584212.402033:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b41ea24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599249280:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784584212.402089:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584212.402122:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41047f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784584212.402207:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599249280 00000100:00100000:0.0:1784584212.402213:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599249280 00000100:00100000:0.0:1784584212.402264:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1784584212.402273:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+20:22744:x1871271599249280:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784584212.402291:0:22742:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784584212.402306:0:22742:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784584212.402309:0:22742:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1784584212.402404:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+20:22744:x1871271599249280:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 131us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584212.402412:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784584212.403342:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b41ea24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599249280:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784584212.403409:0:22744:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784584212.403417:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e49560 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e49567 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584212.403426:0:22744:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e49560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e49567 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584212.403450:0:22744:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784584212.403453:0:22744:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98b405f11000 from 13 10000000:01000000:1.0:1784584212.403456:0:22744:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784584212.403528:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1c400/0xdab2421a42e4956e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584212.403536:0:22744:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b303b1c400/0xdab2421a42e4956e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584212.403824:0:22744:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b303b1c400/0xdab2421a42e4956e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584212.403841:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efaa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599249408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784584212.403881:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584212.403921:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b302b486c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584212.404313:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599249408 00000100:00100000:3.0:1784584212.404320:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599249408 00000100:00100000:3.0:1784584212.404374:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784584212.404382:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+20:22744:x1871271599249408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784584212.404392:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584212.404405:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b418983e00/0xdab2421a42e49575 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e4956e expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584212.404426:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b418983e00/0xdab2421a42e49575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e4956e expref: 21 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584212.404844:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b418983e00/0xdab2421a42e49575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e4956e expref: 21 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584212.404853:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b418983e00, rc 0) 00000100:00100000:3.0:1784584212.404903:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+21:22744:x1871271599249408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 521us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584212.404910:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784584212.405307:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efaa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599249408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784584212.405321:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b303b1c400/0xdab2421a42e4956e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e49575 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584212.405338:0:22744:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b303b1c400/0xdab2421a42e4956e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e49575 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584212.405382:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efaa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599249536:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784584212.405409:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584212.405774:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b302b486c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584212.407255:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599249536 00000100:00100000:3.0:1784584212.407266:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599249536 00000100:00100000:3.0:1784584212.407325:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784584212.407336:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+21:22744:x1871271599249536:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784584212.407361:0:22741:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784584212.407384:0:22741:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784584212.407387:0:22741:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1784584212.407563:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+21:22744:x1871271599249536:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 227us (2150us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584212.407571:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784584212.407825:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efaa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599249536:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784584212.407902:0:22744:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784584212.407911:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1c400/0xdab2421a42e4956e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e49575 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584212.407921:0:22744:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b303b1c400/0xdab2421a42e4956e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e49575 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584212.467319:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584213.166784:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784584213.166808:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599249664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784584213.166891:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584213.166940:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599249664 00000100:00100000:1.0:1784584213.166946:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599249664 00000100:00100000:1.0:1784584213.166992:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784584213.167011:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599249664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784584213.167054:0:22752:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784584213.167100:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599249664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584213.167109:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784584213.167182:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599249664:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784584213.167587:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784584213.167599:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599249792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784584213.167643:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584213.167786:0:23818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599249792 00000100:00100000:0.0:1784584213.167792:0:23818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599249792 00000100:00100000:0.0:1784584213.167828:0:23818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784584213.167836:0:23818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41ea26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599249792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784584213.167858:0:23818:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1784584213.167908:0:23818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41ea26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599249792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584213.167917:0:23818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784584213.167941:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599249792:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1784584213.485637:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584214.509627:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584215.541013:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784584216.237745:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784584216.237752:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784584216.237755:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784584216.237758:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784584216.237783:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1784584216.238077:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b41ea24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599250048:0@lo:400:kworker.0 00000100:00100000:2.0:1784584216.238143:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584216.238194:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b41ea24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:954867da-9a7c-4a17-b608-74c1de1cda93:3639:1871271599249920:0@lo:400:kworker.0 00000100:00100000:2.0:1784584216.238216:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599250048 00000100:00100000:2.0:1784584216.238224:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599250048 00000100:00100000:0.0:1784584216.238242:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584216.238274:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1784584216.238593:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784584216.238597:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784584216.238600:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784584216.238661:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b41ea27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599250176:0@lo:400:kworker.0 00000100:00100000:3.0:1784584216.238690:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584216.238711:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b41ea25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599250688:0@lo:400:kworker.0 00000100:00100000:3.0:1784584216.238736:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584216.238755:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784584216.238760:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b41ea26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599250304:0@lo:400:kworker.0 00000100:00100000:3.0:1784584216.238782:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584216.239041:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599250048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584216.239095:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599250048:12345-0@lo:400:kworker.0 Request processed in 59us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584216.239104:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784584216.239161:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599249920 00000100:00100000:3.0:1784584216.239167:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599249920 00000100:00100000:3.0:1784584216.239197:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784584216.239204:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+21:3639:x1871271599249920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584216.239241:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+21:3639:x1871271599249920:12345-0@lo:400:kworker.0 Request processed in 37us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584216.239247:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784584216.239274:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599250176 00000100:00100000:3.0:1784584216.239278:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599250176 00000100:00100000:0.0:1784584216.239345:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b41ea26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599250432:0@lo:400:kworker.0 00000100:00100000:0.0:1784584216.239385:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584216.239417:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b41ea24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:954867da-9a7c-4a17-b608-74c1de1cda93:3639:1871271599249920:0@lo:400:kworker.0 00000100:00100000:0.0:1784584216.239436:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784584216.239451:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b41ea27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599250560:0@lo:400:kworker.0 00000100:00100000:0.0:1784584216.239508:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584216.239536:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599250688 00000100:00100000:0.0:1784584216.239540:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599250688 00000100:00100000:0.0:1784584216.239572:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599250432 00000100:00100000:0.0:1784584216.239575:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599250432 00000100:00100000:0.0:1784584216.239584:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599250560 00000100:00100000:0.0:1784584216.239586:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599250560 00000100:00100000:0.0:1784584216.239602:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784584216.239608:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41ea24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599250688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584216.239613:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599250304 00000100:00100000:2.0:1784584216.239620:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599250304 00000100:00100000:0.0:1784584216.239652:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41ea24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599250688:12345-0@lo:400:kworker.0 Request processed in 42us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584216.239653:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784584216.239664:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41ea25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599250304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584216.239665:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784584216.239692:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784584216.239700:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599250432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584216.239704:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41ea25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599250304:12345-0@lo:400:kworker.0 Request processed in 40us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584216.239712:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784584216.239743:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599250432:12345-0@lo:400:kworker.0 Request processed in 45us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584216.239750:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784584216.239763:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784584216.239770:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871271599250560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584216.239800:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871271599250560:12345-0@lo:400:kworker.0 Request processed in 32us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584216.239806:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1784584216.239845:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b41ea27800 x1871271599250560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584216.239858:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b41ea27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599250560:0@lo:400:kworker.0 00010000:00080000:0.0:1784584216.239867:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b41ea26d80 x1871271599250432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584216.239876:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b41ea26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599250432:0@lo:400:kworker.0 00000100:00100000:3.0:1784584216.239879:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784584216.239889:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41ea25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599250176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584216.239922:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41ea25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599250176:12345-0@lo:400:kworker.0 Request processed in 35us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584216.239929:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784584216.240389:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b41ea26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599250304:0@lo:400:kworker.0 00010000:00080000:3.0:1784584216.240402:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b41ea27100 x1871271599250176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584216.240411:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b41ea27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599250176:0@lo:400:kworker.0 00010000:00080000:3.0:1784584216.240422:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b41ea25880 x1871271599250688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584216.240430:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b41ea25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599250688:0@lo:400:kworker.0 00000100:00100000:3.0:1784584216.240727:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b41ea24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599250048:0@lo:400:kworker.0 00000100:00080000:0.0:1784584216.241135:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784584216.241142:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1784584216.557783:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784584216.807580:0:24620:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:2.0:1784584217.009287:0:22782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784584217.582641:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784584217.800778:0:24672:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784584217.801823:0:24672:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1784584218.286714:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784584218.286737:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599250816:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784584218.286804:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584218.286884:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599250816 00000100:00100000:0.0:1784584218.286892:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599250816 00000100:00100000:0.0:1784584218.286947:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784584218.286956:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599250816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784584218.286988:0:22753:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1784584218.287044:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599250816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584218.287064:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784584218.287108:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599250816:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784584218.289225:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599250944:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784584218.289307:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584218.289409:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599250944 00000100:00100000:2.0:1784584218.289418:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599250944 00000100:00100000:2.0:1784584218.289545:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784584218.289559:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41ea24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599250944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784584218.289602:0:22752:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1784584218.289675:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41ea24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599250944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584218.289687:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784584218.289780:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599250944:0@lo:41:osp-pre-1-0.0 00000020:00000004:0.0:1784584218.596699:0:24722:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784584218.596963:0:24722:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784584218.605614:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784584219.247715:0:23502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784584219.634080:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584220.656510:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784584221.357632:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784584221.357639:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784584221.357647:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784584221.357650:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784584221.357668:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784584221.357671:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784584221.357673:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784584221.357676:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784584221.357717:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b41ea25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:954867da-9a7c-4a17-b608-74c1de1cda93:3640:1871271599251072:0@lo:400:kworker.0 00000100:00100000:3.0:1784584221.357795:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584221.357858:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b41ea26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599251584:0@lo:400:kworker.0 00000100:00100000:3.0:1784584221.357892:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584221.357924:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784584221.357932:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b41ea27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599251456:0@lo:400:kworker.0 00000100:00100000:3.0:1784584221.357963:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584221.358002:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b41ea27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599251200:0@lo:400:kworker.0 00000100:00100000:3.0:1784584221.358086:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584221.358109:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b41ea27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1871271599251712:0@lo:400:kworker.0 00000100:00100000:3.0:1784584221.358152:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584221.358284:0:23818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599251456 00000100:00100000:2.0:1784584221.358292:0:23818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599251456 00000100:00100000:3.0:1784584221.358296:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784584221.358306:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b41ea26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599251328:0@lo:400:kworker.0 00000100:00100000:3.0:1784584221.358339:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584221.358342:0:23818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599251200 00000100:00100000:2.0:1784584221.358357:0:23818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599251200 00000100:00100000:3.0:1784584221.358364:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b41ea24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599251840:0@lo:400:kworker.0 00000100:00100000:2.0:1784584221.358396:0:23818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784584221.358397:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584221.358421:0:23818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41ea25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599251456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584221.358445:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599251584 00000100:00100000:3.0:1784584221.358457:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599251584 00000100:00100000:2.0:1784584221.358520:0:23818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41ea25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599251456:12345-0@lo:400:kworker.0 Request processed in 113us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584221.358527:0:23818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784584221.358545:0:23818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784584221.358553:0:23818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41ea26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599251200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584221.358557:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599251712 00000100:00100000:3.0:1784584221.358561:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599251712 00000100:00100000:3.0:1784584221.358594:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599251328 00000100:00100000:2.0:1784584221.358599:0:23818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41ea26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599251200:12345-0@lo:400:kworker.0 Request processed in 47us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584221.358600:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599251328 00000100:00100000:2.0:1784584221.358605:0:23818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784584221.358619:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599251840 00000100:00100000:3.0:1784584221.358623:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599251840 00000100:00100000:2.0:1784584221.358628:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784584221.358640:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41ea24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599251584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584221.358647:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784584221.358657:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4105f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871271599251712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584221.358663:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41ea24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871271599251584:12345-0@lo:400:kworker.0 Request processed in 30us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584221.358668:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784584221.358687:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784584221.358696:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4105f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599251328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584221.358702:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4105f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871271599251712:12345-0@lo:400:kworker.0 Request processed in 45us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584221.358710:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784584221.358726:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4105f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599251328:12345-0@lo:400:kworker.0 Request processed in 33us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584221.358732:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784584221.358741:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4105f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599251840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584221.358773:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4105f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599251840:12345-0@lo:400:kworker.0 Request processed in 34us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584221.359074:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599251072 00000100:00100000:1.0:1784584221.359079:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599251072 00000100:00100000:1.0:1784584221.359109:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784584221.359117:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+21:3640:x1871271599251072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584221.359153:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+21:3640:x1871271599251072:12345-0@lo:400:kworker.0 Request processed in 37us (1358us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584221.359160:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1784584221.359285:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1784584221.359318:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b41ea26680 x1871271599251328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584221.359328:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b41ea26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599251328:0@lo:400:kworker.0 00010000:00080000:2.0:1784584221.359339:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b41ea24700 x1871271599251840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584221.359443:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b41ea24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599251840:0@lo:400:kworker.0 00000100:00100000:2.0:1784584221.359457:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b41ea27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599251200:0@lo:400:kworker.0 00010000:00080000:2.0:1784584221.359491:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b41ea27800 x1871271599251712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584221.359499:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b41ea27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1871271599251712:0@lo:400:kworker.0 00000100:00100000:2.0:1784584221.359527:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b41ea27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599251456:0@lo:400:kworker.0 00000100:00100000:2.0:1784584221.359532:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b41ea25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:954867da-9a7c-4a17-b608-74c1de1cda93:3640:1871271599251072:0@lo:400:kworker.0 00010000:00080000:2.0:1784584221.359540:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b41ea26d80 x1871271599251584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584221.359545:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b41ea26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871271599251584:0@lo:400:kworker.0 00000100:00100000:3.0:1784584221.361844:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1784584221.361880:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784584221.361885:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784584221.678133:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584222.125716:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784584207/real 1784584207] req@ffff98b43c8ece00 x1871271599244032/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584222 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584222.125744:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98b43c8ece00 x1871271599244032/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584222 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584222.125755:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784584207/real 1784584207] req@ffff98b43c8ec380 x1871271599243904/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584222 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584222.125766:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98b43c8ec380 x1871271599243904/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584222 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784584222.125793:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43e810800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784584222.125809:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784584222.125813:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599244032:0@lo:8:kworker.0 00000100:00080000:3.0:1784584222.125818:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43e817000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784584222.125822:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784584222.125825:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599243904:0@lo:8:kworker.0 00000100:00080000:2.0:1784584222.126425:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584222.126431:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784584222.126439:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584222.126444:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784584222.126458:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:954867da-9a7c-4a17-b608-74c1de1cda93:3639:1871271599251968:0@lo:400:kworker.0 00000100:00080000:2.0:1784584222.126516:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1784584222.126519:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599252224:0@lo:400:kworker.0 00000100:00080000:2.0:1784584222.126521:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1784584222.126527:0:36:0:(import.c:65:import_set_state_nolock()) ffff98b43e817000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784584222.126534:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 650 00000100:00080000:2.0:1784584222.126539:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784584222.126548:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff98b43e817000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:3.0:1784584222.126551:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584222.126569:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584222.126573:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b302426d80 x1871271599252480/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784584222.126592:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:3.0:1784584222.126594:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:2.0:1784584222.126596:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784584222.126600:0:36:0:(import.c:65:import_set_state_nolock()) ffff98b43e810800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1784584222.126605:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599252096:0@lo:400:kworker.0 00000100:00080000:2.0:1784584222.126606:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 650 00000100:00100000:0.0:1784584222.126606:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:2.0:1784584222.126613:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00100000:0.0:1784584222.126619:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599252352:0@lo:400:kworker.0 00000100:00080000:2.0:1784584222.126620:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98b43e810800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:3.0:1784584222.126642:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584222.126642:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b302425c00 x1871271599252608/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784584222.126667:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599252224 00000100:00100000:0.0:1784584222.126674:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599252224 00000100:00100000:3.0:1784584222.126679:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599252736:0@lo:400:kworker.0 00000100:00100000:2.0:1784584222.126706:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599252864:0@lo:400:kworker.0 00000100:00100000:3.0:1784584222.126711:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584222.126724:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599252736 00000100:00100000:0.0:1784584222.126728:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599252736 00000100:00100000:3.0:1784584222.126746:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599251968 00000100:00100000:2.0:1784584222.126751:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584222.126752:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599251968 00000100:00100000:3.0:1784584222.126789:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1784584222.126797:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784584222.126798:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+21:3639:x1871271599251968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584222.126810:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1871271599252992:0@lo:400:kworker.0 00000100:00100000:3.0:1784584222.126848:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+21:3639:x1871271599251968:12345-0@lo:400:kworker.0 Request processed in 51us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584222.126854:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584222.126862:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1784584222.126886:0:23818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599252096 00000100:00100000:2.0:1784584222.126898:0:23818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599252096 00000100:00100000:3.0:1784584222.126900:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599252480:0@lo:8:kworker.0 00000100:00100000:0.0:1784584222.126901:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599252864 00000100:00100000:0.0:1784584222.126907:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599252864 00000100:00100000:0.0:1784584222.126933:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599252992 00000100:00100000:3.0:1784584222.126938:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584222.126940:0:23818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784584222.126948:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599252992 00000100:00100000:2.0:1784584222.126951:0:23818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4105f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599252096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584222.126962:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599252608:0@lo:8:kworker.0 00000100:00100000:0.0:1784584222.126973:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784584222.126985:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599252224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584222.127000:0:23818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4105f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599252096:12345-0@lo:400:kworker.0 Request processed in 51us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584222.127009:0:23818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784584222.127025:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584222.127035:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871271599252224:12345-0@lo:400:kworker.0 Request processed in 51us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584222.127040:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784584222.127051:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784584222.127055:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4105f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599252736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584222.127074:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784584222.127084:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599252096:0@lo:400:kworker.0 00000100:00100000:0.0:1784584222.127086:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599252864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584222.127099:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4105f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599252736:12345-0@lo:400:kworker.0 Request processed in 47us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584222.127104:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:954867da-9a7c-4a17-b608-74c1de1cda93:3639:1871271599251968:0@lo:400:kworker.0 00000100:00100000:2.0:1784584222.127110:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784584222.127135:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1784584222.127139:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b302424380 x1871271599252736/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584222.127139:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599252864:12345-0@lo:400:kworker.0 Request processed in 54us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584222.127148:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871271599252992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584222.127160:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784584222.127164:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599252736:0@lo:400:kworker.0 00000100:00100000:3.0:1784584222.127196:0:24253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599252480 00000100:00100000:2.0:1784584222.127197:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871271599252992:12345-0@lo:400:kworker.0 Request processed in 53us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584222.127203:0:24253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599252480 00000100:00100000:0.0:1784584222.127204:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584222.127213:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784584222.127227:0:24253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599252608 00000100:00100000:3.0:1784584222.127231:0:24253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599252608 00010000:00080000:0.0:1784584222.127244:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b302427b80 x1871271599252224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584222.127250:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784584222.127259:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871271599252224:0@lo:400:kworker.0 00000100:00100000:3.0:1784584222.127261:0:24253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4105f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1871271599252480:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1784584222.127263:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599252352 00000100:00100000:2.0:1784584222.127270:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599252352 00010000:00080000:3.0:1784584222.127289:0:24253:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 665 last 0 00000100:00100000:2.0:1784584222.127300:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784584222.127309:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599252352:12345-0@lo:400:kworker.0 00000020:00000080:3.0:1784584222.127316:0:24253:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdab2421a42e4957c 00002000:00100000:3.0:1784584222.127332:0:24253:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff98b3026d8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136b7 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1784584222.127336:0:24253:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1784584222.127339:0:24253:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1784584222.127357:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599252352:12345-0@lo:400:kworker.0 Request processed in 49us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584222.127364:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1784584222.127390:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b302427100 x1871271599252864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584222.127400:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599252864:0@lo:400:kworker.0 00010000:00080000:2.0:1784584222.127442:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b302426a00 x1871271599252992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584222.127451:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1871271599252992:0@lo:400:kworker.0 00000100:00100000:0.0:1784584222.127518:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599252352:0@lo:400:kworker.0 00002000:00080000:3.0:1784584222.127696:0:24253:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1784584222.127717:0:24253:0:(import.c:65:import_set_state_nolock()) ffff98b3026d9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784584222.127765:0:24253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4105f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1871271599252480:12345-0@lo:8:kworker.0 Request processed in 503us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584222.127771:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784584222.127785:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784584222.127789:0:24253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4105f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1871271599252608:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1784584222.127801:0:24253:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1784584222.129418:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b302426d80 x1871271599252480/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784584242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584222.129434:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784584222.129443:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1784584222.129452:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784584222.129458:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1784584222.129461:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43e817000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784584222.129495:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784584222.129502:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599252480:0@lo:8:kworker.0 00000004:00080000:0.0:1784584222.129899:0:23490:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1784584222.129920:0:23490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ef800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23490:1871271599253248:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1784584222.130206:0:23490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584222.130236:0:23490:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cb32300 going to sleep for 11 seconds 00000004:00080000:0.0:1784584222.130252:0:23489:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1784584222.130522:0:24255:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1784584222.130531:0:24255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1784584222.130633:0:24255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599253248 00000100:00100000:2.0:1784584222.130639:0:24255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599253248 00000100:00100000:2.0:1784584222.130750:0:24895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784584222.130760:0:24895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23490:x1871271599253248:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1784584222.131676:0:23489:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 665317205885ns, next at 0ns, rc = 0 00080000:00080000:0.0:1784584222.131687:0:23489:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1784584222.131726:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599253120:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784584222.132195:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784584222.132361:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1784584222.134551:0:23481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:0.0:1784584222.137647:0:24895:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1784584222.137656:0:24895:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1784584222.138097:0:24895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23490:x1871271599253248:12345-0@lo:7:osp-pre-0-1.0 Request processed in 7334us (7886us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584222.138113:0:24895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1784584222.138196:0:23490:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b43c8ef800 x1871271599253248/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784584238 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584222.138212:0:23490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ef800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23490:1871271599253248:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1784584222.138226:0:23490:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:1.0:1784584222.138264:0:23490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efaa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23490:1871271599253376:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1784584222.138301:0:23490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584222.138363:0:23490:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b302b48e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784584222.138586:0:24255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599253376 00000100:00100000:0.0:1784584222.138592:0:24255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599253376 00000100:00100000:0.0:1784584222.138660:0:24255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784584222.138669:0:24255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23490:x1871271599253376:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1784584222.138695:0:24255:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1784584222.138748:0:24255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23490:x1871271599253376:12345-0@lo:5:osp-pre-0-1.0 Request processed in 64us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584222.138766:0:24255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1784584222.139008:0:23490:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b43efaa680 x1871271599253376/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784584238 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584222.139018:0:23490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efaa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23490:1871271599253376:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1784584222.139028:0:23490:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1784584222.142570:0:24257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599253120 00000100:00100000:0.0:1784584222.142583:0:24257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599253120 00000100:00100000:0.0:1784584222.142643:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784584222.142653:0:24257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1871271599253120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784584222.142683:0:24257:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1784584222.142770:0:24257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1871271599253120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 119us (10575us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584222.142778:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1784584222.142821:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b43c8ec000 x1871271599253120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584222.143025:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599253120:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784584222.152440:0:24253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4105f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1871271599252608:12345-0@lo:8:kworker.0 Request processed in 24642us (25409us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784584222.152457:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1784584222.152514:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43e810800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784584222.152521:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784584222.152525:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599252608:0@lo:8:kworker.0 00010000:00010000:2.0:1784584222.702700:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584223.406684:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599253504:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784584223.407017:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584223.407064:0:23818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599253504 00000100:00100000:0.0:1784584223.407071:0:23818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599253504 00000100:00100000:0.0:1784584223.407111:0:23818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784584223.407118:0:23818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599253504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784584223.407148:0:23818:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1784584223.407184:0:23818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599253504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584223.407191:0:23818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784584223.407235:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599253504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784584223.409114:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599253632:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784584223.409163:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584223.409203:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599253632 00000100:00100000:2.0:1784584223.409208:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599253632 00000100:00100000:2.0:1784584223.409588:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784584223.409598:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599253632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784584223.409635:0:22753:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1784584223.409677:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599253632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584223.409684:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784584223.409729:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599253632:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784584223.735069:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584224.749615:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784584224.948348:0:25069:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784584224.948353:0:25069:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1784584224.948354:0:25069:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1784584224.948626:0:25069:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff98b302b3b000 00000020:01000004:2.0:1784584224.948642:0:25069:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1784584224.948718:0:25069:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1784584224.948794:0:25069:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff98b4071a8000) 00000020:00000080:2.0:1784584224.948815:0:25069:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1784584225.019784:0:25069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1784584225.022923:0:25069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1784584225.023514:0:25069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1784584225.023837:0:25069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1784584225.024129:0:25069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1784584225.024356:0:25069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1784584225.024669:0:25069:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:3.0:1784584225.032408:0:25069:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1784584225.033145:0:25069:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1784584225.033160:0:25069:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784584225.033173:0:25069:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdab2421a42e4958a 00000020:01000004:3.0:1784584225.033180:0:25069:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1784584225.033201:0:25069:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.151@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1784584225.033204:0:25069:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1784584225.033210:0:25069:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1784584225.033243:0:25069:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1784584225.033246:0:25069:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.151@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1784584225.054417:0:25069:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.151@tcp ctxt 0 is initialized 00000020:01000004:1.0:1784584225.054456:0:25069:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.151@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1784584225.054461:0:25069:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1784584225.054463:0:25069:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784584225.054464:0:25069:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784584225.054621:0:25069:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784584225.054624:0:25069:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784584225.054626:0:25069:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784584225.054627:0:25069:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784584225.054629:0:25069:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784584225.054630:0:25069:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784584225.054634:0:25069:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1784584225.054637:0:25069:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784584225.054638:0:25069:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784584225.054640:0:25069:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784584225.054641:0:25069:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784584225.054642:0:25069:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784584225.054643:0:25069:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784584225.054644:0:25069:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784584225.054645:0:25069:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784584225.054646:0:25069:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784584225.054674:0:25069:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1784584225.054697:0:25069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599253760:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784584225.054824:0:25069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584225.054937:0:25069:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784584225.055002:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599253760 00000100:00100000:3.0:1784584225.055011:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599253760 00000100:00100000:3.0:1784584225.055251:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784584225.055261:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+21:25069:x1871271599253760:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784584225.055302:0:22740:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1784584225.055305:0:22740:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1784584225.055309:0:22740:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1784584225.055753:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+21:25069:x1871271599253760:12345-0@lo:253:mount.lustre.0 Request processed in 492us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584225.055761:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784584225.055934:0:25069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599253760:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784584225.055944:0:25069:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1784584225.055947:0:25069:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784584225.055948:0:25069:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784584225.055949:0:25069:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784584225.055950:0:25069:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784584225.055951:0:25069:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784584225.055953:0:25069:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784584225.055954:0:25069:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784584225.055955:0:25069:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784584225.055964:0:25069:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1784584225.055982:0:25069:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98b302b3b000 from lustre-OST0001 10000000:01000000:1.0:1784584225.056008:0:25069:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1784584225.056011:0:25069:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1784584225.056019:0:25069:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98b302bf0000 local copy 00010000:00010000:1.0:1784584225.056030:0:25069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418983600/0xdab2421a42e492a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e492ab expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584225.056240:0:25069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599253888:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584225.056274:0:25069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584225.056351:0:25069:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584225.056395:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599253888 00000100:00100000:3.0:1784584225.056400:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599253888 00000100:00100000:3.0:1784584225.056505:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1784584225.056514:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+21:25069:x1871271599253888:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784584225.056591:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+21:25069:x1871271599253888:12345-0@lo:501:mount.lustre.0 Request processed in 77us (315us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784584225.056598:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1784584225.056673:0:25069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599253888:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1784584225.056688:0:25069:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1784584225.056704:0:25069:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1784584225.056710:0:25069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b418983600/0xdab2421a42e492a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e492ab expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584225.056719:0:25069:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b418983600/0xdab2421a42e492a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e492ab expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584225.056756:0:25069:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98b302b3b000 10000000:01000000:1.0:1784584225.056761:0:25069:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784584225.056765:0:25069:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1784584225.056768:0:25069:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784584225.056772:0:25069:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1784584225.056775:0:25069:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1784584225.056797:0:25069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e49591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584225.056806:0:25069:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e49591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584225.056821:0:25069:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e49591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584225.056834:0:25069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599254016:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784584225.056873:0:25069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584225.057284:0:25069:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784584225.057362:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599254016 00000100:00100000:0.0:1784584225.057368:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599254016 00000100:00100000:0.0:1784584225.057405:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1784584225.057412:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+21:25069:x1871271599254016:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784584225.057422:0:22741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584225.057436:0:22741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b4332b8800/0xdab2421a42e49598 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e49591 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584225.057459:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4332b8800/0xdab2421a42e49598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e49591 expref: 22 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584225.057983:0:22741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b4332b8800/0xdab2421a42e49598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e49591 expref: 22 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584225.057993:0:22741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b8800, rc 0) 00000100:00100000:0.0:1784584225.058052:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+22:25069:x1871271599254016:12345-0@lo:101:mount.lustre.0 Request processed in 640us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584225.058060:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1784584225.058219:0:25069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599254016:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784584225.058233:0:25069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e49591 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e49598 expref: -99 pid: 25069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584225.058242:0:25069:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e49591 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e49598 expref: -99 pid: 25069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784584225.059598:0:25069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:0.0:1784584225.060233:0:25069:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784584225.062984:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1784584225.063033:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1784584225.063061:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1784584225.063088:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1784584225.063104:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1784584225.063119:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1784584225.063134:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1784584225.063149:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1784584225.063163:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:0.0:1784584225.063201:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:0.0:1784584225.063207:0:25069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:0.0:1784584225.063308:0:25069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599254144:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784584225.063367:0:25069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584225.063415:0:25069:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41047f840 going to sleep for 11 seconds 00000100:00100000:3.0:1784584225.063661:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599254144 00000100:00100000:3.0:1784584225.063667:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599254144 00000100:00100000:3.0:1784584225.063719:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1784584225.063727:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+22:25069:x1871271599254144:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784584225.063884:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+22:25069:x1871271599254144:12345-0@lo:501:mount.lustre.0 Request processed in 156us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584225.063891:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784584225.064194:0:25069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599254144:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584225.064229:0:25069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599254272:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784584225.064270:0:25069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584225.064300:0:25069:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4055d3480 going to sleep for 11 seconds 00000100:00100000:3.0:1784584225.064359:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599254272 00000100:00100000:3.0:1784584225.064363:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599254272 00000100:00100000:3.0:1784584225.064404:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1784584225.064413:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+22:25069:x1871271599254272:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784584225.065408:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+22:25069:x1871271599254272:12345-0@lo:503:mount.lustre.0 Request processed in 993us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584225.065419:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784584225.065769:0:25069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599254272:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784584225.067009:0:25069:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784584225.067225:0:25069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599254400:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784584225.067289:0:25069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584225.067370:0:25069:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7c3840 going to sleep for 11 seconds 00000100:00100000:0.0:1784584225.067692:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599254400 00000100:00100000:0.0:1784584225.067700:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599254400 00000100:00100000:0.0:1784584225.067850:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1784584225.067933:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+22:25069:x1871271599254400:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784584225.068881:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+22:25069:x1871271599254400:12345-0@lo:502:mount.lustre.0 Request processed in 1019us (1588us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584225.068891:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1784584225.069214:0:25069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599254400:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784584225.069456:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1784584225.069639:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1784584225.069655:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1784584225.069669:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1784584225.069681:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1784584225.069693:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1784584225.069709:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1784584225.069723:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1784584225.069804:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1784584225.069842:0:25069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599254528:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784584225.069962:0:25069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584225.069991:0:25069:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7c3840 going to sleep for 11 seconds 00000100:00100000:3.0:1784584225.070190:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599254528 00000100:00100000:3.0:1784584225.070197:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599254528 00000100:00100000:3.0:1784584225.070283:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1784584225.070292:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+22:25069:x1871271599254528:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584225.070398:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+22:25069:x1871271599254528:12345-0@lo:502:mount.lustre.0 Request processed in 107us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584225.070406:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1784584225.070600:0:25069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599254528:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784584225.070646:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1784584225.070656:0:25069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1784584225.071629:0:25073:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784584225.071639:0:25073:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1784584225.071646:0:25073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584225.071648:0:25073:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1784584225.071655:0:25073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784584225.071669:0:25073:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff98b302a499c0) 00000020:00000080:2.0:1784584225.071694:0:25073:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1784584225.071700:0:25073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784584225.071937:0:25073:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98b302b3b000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1784584225.071947:0:25073:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784584225.071954:0:25073:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdab2421a42e495a6 00010000:00010000:2.0:1784584225.077996:0:25073:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1784584225.078939:0:25073:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:3.0:1784584225.081397:0:25073:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1784584225.083433:0:25073:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1784584225.083444:0:25073:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784584225.083450:0:25073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584225.083452:0:25073:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1784584225.083455:0:25073:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784584225.083458:0:25073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584225.083460:0:25073:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784584225.083462:0:25073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784584225.083464:0:25073:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784584225.083503:0:25073:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784584225.083506:0:25073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584225.083507:0:25073:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784584225.083509:0:25073:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784584225.083511:0:25073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584225.083513:0:25073:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784584225.083516:0:25073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1784584225.083541:0:25073:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784584225.083543:0:25073:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584225.083544:0:25073:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784584225.083547:0:25073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:2.0:1784584225.083755:0:25069:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1784584225.083783:0:25069:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1784584225.083796:0:25069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e49591 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e49598 expref: -99 pid: 25069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584225.083808:0:25069:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b303b1d600/0xdab2421a42e49591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e49598 expref: -99 pid: 25069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584225.083816:0:25069:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b302b3b000 from 1 10000000:01000000:2.0:1784584225.083818:0:25069:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784584225.083851:0:25069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e495ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584225.083868:0:25069:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e495ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584225.083879:0:25069:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e495ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584225.083902:0:25069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599254656:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784584225.083966:0:25069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584225.084004:0:25069:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4055d3480 going to sleep for 11 seconds 00000100:00100000:3.0:1784584225.084148:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599254656 00000100:00100000:3.0:1784584225.084155:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599254656 00000100:00100000:3.0:1784584225.084200:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1784584225.084208:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+22:25069:x1871271599254656:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784584225.084220:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584225.084231:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b418982c00/0xdab2421a42e495b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e495ad expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584225.084255:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b418982c00/0xdab2421a42e495b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e495ad expref: 23 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584225.084265:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b418982c00/0xdab2421a42e495b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e495ad expref: 23 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584225.084282:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b418982c00, rc 0) 00000100:00100000:3.0:1784584225.084314:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+23:25069:x1871271599254656:12345-0@lo:101:mount.lustre.0 Request processed in 108us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584225.084321:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784584225.084660:0:25069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599254656:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784584225.084674:0:25069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e495ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e495b4 expref: -99 pid: 25069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584225.084696:0:25069:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e495ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e495b4 expref: -99 pid: 25069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784584225.085838:0:25069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1784584225.086656:0:25069:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784584225.087017:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1784584225.087188:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1784584225.087211:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1784584225.087225:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1784584225.087239:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1784584225.087252:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1784584225.087266:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1784584225.087278:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1784584225.087290:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1784584225.087303:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1784584225.087316:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1784584225.087334:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1784584225.087339:0:25069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1784584225.087439:0:25069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599254784:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584225.087691:0:25069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584225.088222:0:25069:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4033e2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784584225.090853:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599254784 00000100:00100000:1.0:1784584225.090875:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599254784 00000100:00100000:1.0:1784584225.090935:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784584225.090946:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+23:25069:x1871271599254784:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584225.091329:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+23:25069:x1871271599254784:12345-0@lo:501:mount.lustre.0 Request processed in 384us (3637us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584225.091338:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784584225.091443:0:25069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599254784:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584225.091529:0:25069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599254912:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784584225.091576:0:25069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584225.091614:0:25069:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4033e2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784584225.091799:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599254912 00000100:00100000:1.0:1784584225.091805:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599254912 00000100:00100000:1.0:1784584225.091842:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1784584225.091850:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+23:25069:x1871271599254912:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784584225.092005:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+23:25069:x1871271599254912:12345-0@lo:503:mount.lustre.0 Request processed in 156us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584225.092023:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1784584225.092213:0:25069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599254912:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784584225.092849:0:25069:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784584225.093013:0:25069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599255040:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784584225.093262:0:25069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584225.093300:0:25069:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4033e2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784584225.093363:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599255040 00000100:00100000:1.0:1784584225.093369:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599255040 00000100:00100000:1.0:1784584225.093446:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784584225.093455:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+23:25069:x1871271599255040:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784584225.093598:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+23:25069:x1871271599255040:12345-0@lo:502:mount.lustre.0 Request processed in 144us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584225.093606:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784584225.093691:0:25069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599255040:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784584225.093917:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1784584225.093946:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1784584225.093961:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1784584225.093975:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1784584225.093987:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1784584225.093998:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1784584225.094010:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1784584225.094024:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1784584225.094037:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1784584225.094064:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1784584225.096973:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1784584225.097032:0:25069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599255168:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784584225.097255:0:25069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584225.100310:0:25069:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41047f540 going to sleep for 11 seconds 00000100:00100000:2.0:1784584225.100463:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599255168 00000100:00100000:2.0:1784584225.100498:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599255168 00000100:00100000:2.0:1784584225.100547:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1784584225.100557:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+23:25069:x1871271599255168:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784584225.100715:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+23:25069:x1871271599255168:12345-0@lo:502:mount.lustre.0 Request processed in 159us (3459us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584225.100724:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784584225.100988:0:25069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599255168:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784584225.101088:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1784584225.101102:0:25069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1784584225.102129:0:25077:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584225.102140:0:25077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584225.102142:0:25077:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784584225.102151:0:25077:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98b302b3b000 00000020:00000080:0.0:1784584225.102153:0:25077:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784584225.102161:0:25077:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584225.102163:0:25077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584225.102165:0:25077:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1784584225.102167:0:25077:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584225.102170:0:25077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584225.102171:0:25077:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1784584225.102174:0:25077:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98b302b3b000 00000020:00000080:0.0:1784584225.102176:0:25077:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784584225.102232:0:25077:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584225.102236:0:25077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584225.102237:0:25077:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1784584225.102240:0:25077:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584225.102243:0:25077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584225.102244:0:25077:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784584225.102247:0:25077:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98b302b3b000 00000020:00000080:0.0:1784584225.102249:0:25077:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784584225.102266:0:25077:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584225.102270:0:25077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584225.102271:0:25077:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784584225.102273:0:25077:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584225.102276:0:25077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584225.102277:0:25077:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1784584225.102281:0:25077:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98b302b3b000 00000020:00000080:0.0:1784584225.102282:0:25077:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784584225.102302:0:25077:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584225.102313:0:25077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584225.102314:0:25077:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1784584225.102317:0:25077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1784584225.114416:0:25069:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1784584225.117772:0:25069:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784584225.117799:0:25069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e495ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e495b4 expref: -99 pid: 25069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584225.117812:0:25069:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e495ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e495b4 expref: -99 pid: 25069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584225.118015:0:25069:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784584225.118018:0:25069:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98b302b3b000 10000000:01000000:2.0:1784584225.118022:0:25069:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98b302b3b000 10000000:01000000:2.0:1784584225.118026:0:25069:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784584225.118032:0:25069:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98b302b3b000 from 1 10000000:01000000:2.0:1784584225.118035:0:25069:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784584225.118134:0:25069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b800/0xdab2421a42e495bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584225.118143:0:25069:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b800/0xdab2421a42e495bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584225.118168:0:25069:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b800/0xdab2421a42e495bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584225.118193:0:25069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599255296:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784584225.118259:0:25069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584225.118308:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599255296 00000100:00100000:2.0:1784584225.118314:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599255296 00000100:00100000:2.0:1784584225.118356:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1784584225.118366:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+23:25069:x1871271599255296:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784584225.118378:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584225.118400:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ea7ba00/0xdab2421a42e495c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e495bb expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584225.118422:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ea7ba00/0xdab2421a42e495c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e495bb expref: 24 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584225.118433:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ea7ba00/0xdab2421a42e495c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e495bb expref: 24 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584225.118441:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7ba00, rc 0) 00000100:00100000:2.0:1784584225.118961:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+24:25069:x1871271599255296:12345-0@lo:101:mount.lustre.0 Request processed in 595us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584225.118969:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1784584225.119020:0:25069:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cba1180 going to sleep for 11 seconds 00000100:00100000:2.0:1784584225.119051:0:25069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599255296:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784584225.119065:0:25069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b800/0xdab2421a42e495bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e495c2 expref: -99 pid: 25069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584225.120644:0:25069:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b800/0xdab2421a42e495bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e495c2 expref: -99 pid: 25069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784584225.125212:0:25069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1784584225.127670:0:25069:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784584225.128445:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1784584225.129684:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1784584225.129712:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1784584225.129725:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1784584225.130620:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1784584225.130643:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1784584225.130661:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1784584225.130678:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1784584225.130694:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1784584225.130711:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1784584225.130728:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1784584225.130758:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1784584225.130776:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1784584225.130793:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1784584225.130812:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1784584225.130847:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1784584225.132022:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1784584225.132994:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1784584225.133027:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1784584225.133056:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1784584225.133288:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1784584225.133309:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1784584225.133325:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1784584225.133343:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1784584225.133358:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1784584225.133397:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1784584225.133413:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1784584225.133426:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1784584225.133440:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1784584225.133453:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1784584225.135003:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1784584225.135660:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1784584225.135697:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1784584225.135714:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1784584225.135745:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1784584225.135761:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1784584225.135776:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1784584225.135793:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1784584225.135809:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1784584225.135825:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1784584225.135841:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1784584225.135866:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1784584225.135886:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1784584225.135902:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1784584225.136959:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1784584225.136992:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1784584225.137007:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1784584225.137039:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1784584225.138325:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1784584225.138354:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1784584225.138373:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1784584225.138380:0:25069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1784584225.139956:0:25069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4105f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599255424:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784584225.140020:0:25069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584225.140864:0:25069:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7c3840 going to sleep for 11 seconds 00000100:00100000:2.0:1784584225.140943:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599255424 00000100:00100000:2.0:1784584225.140951:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599255424 00000100:00100000:2.0:1784584225.141009:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784584225.141018:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+24:25069:x1871271599255424:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584225.141305:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+24:25069:x1871271599255424:12345-0@lo:501:mount.lustre.0 Request processed in 286us (1284us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584225.141312:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784584225.142709:0:25069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4105f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599255424:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784584225.142789:0:25069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4105f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599255552:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784584225.142848:0:25069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584225.144274:0:25069:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7c3840 going to sleep for 11 seconds 00000100:00100000:2.0:1784584225.152236:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599255552 00000100:00100000:2.0:1784584225.152249:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599255552 00000100:00100000:2.0:1784584225.152293:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784584225.152303:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+24:25069:x1871271599255552:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784584225.152462:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+24:25069:x1871271599255552:12345-0@lo:503:mount.lustre.0 Request processed in 160us (9613us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584225.154256:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784584225.157268:0:25069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4105f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599255552:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784584225.157764:0:25069:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784584225.157893:0:25069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599255680:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784584225.157969:0:25069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584225.158009:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599255680 00000100:00100000:2.0:1784584225.158015:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599255680 00000100:00100000:2.0:1784584225.158091:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784584225.158110:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+24:25069:x1871271599255680:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784584225.158218:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+24:25069:x1871271599255680:12345-0@lo:502:mount.lustre.0 Request processed in 110us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584225.158227:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784584225.158282:0:25069:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cba1180 going to sleep for 11 seconds 00000100:00100000:2.0:1784584225.158300:0:25069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599255680:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784584225.158519:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1784584225.158545:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1784584225.158559:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1784584225.158570:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1784584225.158587:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1784584225.158598:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1784584225.158609:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1784584225.158620:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1784584225.158632:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1784584225.158643:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1784584225.158654:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1784584225.158667:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1784584225.158679:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1784584225.158690:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1784584225.158702:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1784584225.158717:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1784584225.158732:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1784584225.158766:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1784584225.158789:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1784584225.158808:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1784584225.158820:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1784584225.158831:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1784584225.158844:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1784584225.158859:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1784584225.158888:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1784584225.158906:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1784584225.158920:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1784584225.158934:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1784584225.158947:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1784584225.158960:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1784584225.158976:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1784584225.158990:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1784584225.159005:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1784584225.159038:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1784584225.159060:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1784584225.159079:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1784584225.159098:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1784584225.159116:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1784584225.159134:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1784584225.159152:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1784584225.159172:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1784584225.159188:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1784584225.159205:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1784584225.159219:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1784584225.159231:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1784584225.159243:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1784584225.159254:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1784584225.159266:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1784584225.159317:0:25069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599255808:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784584225.159362:0:25069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584225.159395:0:25069:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cba1180 going to sleep for 11 seconds 00000100:00100000:3.0:1784584225.160277:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599255808 00000100:00100000:3.0:1784584225.160286:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599255808 00000100:00100000:3.0:1784584225.160336:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1784584225.160343:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+24:25069:x1871271599255808:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584225.160501:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+24:25069:x1871271599255808:12345-0@lo:502:mount.lustre.0 Request processed in 157us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584225.160508:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784584225.161037:0:25069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599255808:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784584225.161351:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1784584225.161379:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1784584225.161422:0:25069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302427100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599255936:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784584225.161505:0:25069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584225.161540:0:25069:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41e7c3840 going to sleep for 11 seconds 00000100:00100000:3.0:1784584225.161674:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599255936 00000100:00100000:3.0:1784584225.161680:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599255936 00000100:00100000:3.0:1784584225.161723:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784584225.161732:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+24:25069:x1871271599255936:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584225.161824:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+24:25069:x1871271599255936:12345-0@lo:502:mount.lustre.0 Request processed in 83us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584225.161832:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1784584225.162016:0:25069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302427100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599255936:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784584225.162202:0:25069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1784584225.162211:0:25069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1784584225.173877:0:25083:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1784584225.173895:0:25083:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff98b3024799c0) 00000020:00000080:0.0:1784584225.173922:0:25083:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1784584225.175325:0:25083:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98b302b3b000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1784584225.175331:0:25083:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98b302b3b000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1784584225.175334:0:25083:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b302b3b000 3 00010000:00080000:0.0:1784584225.175370:0:25083:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b437661800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.151@tcp at head 00010000:00010000:2.0:1784584225.181767:0:25083:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1784584225.181917:0:25083:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1784584225.181970:0:25083:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784584225.182104:0:25083:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xdab2421a42e495d0 00000100:00080000:3.0:1784584225.182116:0:25083:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784584225.182123:0:25083:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98b437661800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:3.0:1784584225.182157:0:25083:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b4105f7100 x1871271599256064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784584225.182185:0:25083:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784584225.182315:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784584225.182319:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784584225.182322:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784584225.182325:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784584225.182363:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784584225.182366:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1784584225.182368:0:36:0:(import.c:65:import_set_state_nolock()) ffff98b43e810800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784584225.182372:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 665 00000100:00080000:1.0:1784584225.182376:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1784584225.182379:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98b43e810800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:1.0:1784584225.182403:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b43efa8e00 x1871271599256704/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784584225.182673:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599256448:0@lo:400:kworker.0 00000100:00100000:3.0:1784584225.182739:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584225.182776:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599257088:0@lo:400:kworker.0 00000100:00100000:3.0:1784584225.182801:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584225.182835:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784584225.182841:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599256576:0@lo:400:kworker.0 00000100:00100000:3.0:1784584225.182862:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584225.182913:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599257088 00000100:00100000:1.0:1784584225.182921:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599257088 00000100:00100000:1.0:1784584225.182976:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784584225.182984:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4105f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599257088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584225.183034:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4105f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599257088:12345-0@lo:400:kworker.0 Request processed in 50us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584225.183041:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1784584225.183085:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1784584225.183109:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b43efab100 x1871271599257088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584225.183122:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599257088:0@lo:400:kworker.0 00000100:00100000:0.0:1784584225.183730:0:24895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599256576 00000100:00100000:0.0:1784584225.183736:0:24895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599256576 00000100:00100000:0.0:1784584225.183783:0:24895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784584225.183794:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599256320:0@lo:400:kworker.0 00000100:00100000:0.0:1784584225.183795:0:24895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4105f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3639:x1871271599256576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584225.183839:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584225.183863:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1871271599256960:0@lo:400:kworker.0 00000100:00100000:3.0:1784584225.183883:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584225.183900:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1784584225.183905:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599256192:0@lo:400:kworker.0 00000100:00100000:3.0:1784584225.183927:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584225.183942:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599256832:0@lo:400:kworker.0 00000100:00100000:3.0:1784584225.183962:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784584225.184053:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784584225.184062:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599256320 00000100:00100000:3.0:1784584225.184066:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599256320 00000100:00100000:3.0:1784584225.184085:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599256960 00000100:00100000:3.0:1784584225.184087:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599256960 00000100:00100000:3.0:1784584225.184104:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599256832 00000100:00100000:3.0:1784584225.184107:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599256832 00000100:00100000:3.0:1784584225.184120:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784584225.184125:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4105f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599256320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584225.184167:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4105f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599256320:12345-0@lo:400:kworker.0 Request processed in 41us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584225.184175:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784584225.184190:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784584225.184207:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4105f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871271599256960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584225.184236:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4105f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871271599256960:12345-0@lo:400:kworker.0 Request processed in 40us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584225.184242:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784584225.184253:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784584225.184259:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4105f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599256832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584225.184283:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4105f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599256832:12345-0@lo:400:kworker.0 Request processed in 24us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584225.184289:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1784584225.184305:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784584225.184329:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b43efab480 x1871271599256832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584225.184337:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4105f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1871271599256064:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784584225.184344:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599256832:0@lo:400:kworker.0 00010000:00080000:3.0:1784584225.184359:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b43efa9c00 x1871271599256320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584225.184367:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599256320:0@lo:400:kworker.0 00010000:00080000:3.0:1784584225.184379:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b43efa9f80 x1871271599256960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584225.184392:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584225.184405:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1871271599256960:0@lo:400:kworker.0 00000100:00100000:2.0:1784584225.184436:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599256704:0@lo:8:kworker.0 00010000:00080000:3.0:1784584225.184453:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b43efa9180 x1871271599256576/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584225.184486:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584225.184502:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599256576:0@lo:400:kworker.0 00000100:00100000:2.0:1784584225.184533:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599256448 00000100:00100000:2.0:1784584225.184538:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599256448 00000100:00100000:2.0:1784584225.184572:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599256192 00000100:00100000:2.0:1784584225.184576:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599256192 00000100:00100000:2.0:1784584225.184591:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784584225.184597:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4105f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599256448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584225.184643:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4105f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599256448:12345-0@lo:400:kworker.0 Request processed in 45us (1903us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584225.184652:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784584225.184667:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784584225.184673:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4105f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599256192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584225.184708:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4105f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599256192:12345-0@lo:400:kworker.0 Request processed in 35us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584225.184715:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784584225.184746:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599256064 00000100:00100000:2.0:1784584225.184750:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599256064 00000100:00100000:2.0:1784584225.184764:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784584225.184769:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1871271599256064:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1784584225.184790:0:22749:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 668 last 0 00000020:00000080:2.0:1784584225.184825:0:22749:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xdab2421a42e495d7 00000004:00100000:2.0:1784584225.184840:0:22749:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784584225.184887:0:22749:0:(import.c:65:import_set_state_nolock()) ffff98b302474000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784584225.184928:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1871271599256064:12345-0@lo:38:llog_process_th.0 Request processed in 157us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584225.184935:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784584225.184963:0:24255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599256704 00000100:00100000:2.0:1784584225.184966:0:24255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599256704 00000100:00100000:2.0:1784584225.184994:0:24255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784584225.184999:0:24255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3638:x1871271599256704:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1784584225.185036:0:24255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3638:x1871271599256704:12345-0@lo:8:kworker.0 Request processed in 36us (569us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784584225.185042:0:24255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1784584225.185078:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b4105f7100 x1871271599256064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784584235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584225.185087:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784584225.185094:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1784584225.185101:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1784584225.185105:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784584225.185108:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b437661800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784584225.185113:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4105f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1871271599256064:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784584225.185136:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784584225.185140:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43e810800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784584225.185144:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784584225.185147:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599256704:0@lo:8:kworker.0 00000100:00100000:2.0:1784584225.185175:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599256192:0@lo:400:kworker.0 00000100:00100000:2.0:1784584225.185196:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599256448:0@lo:400:kworker.0 00000020:01000004:3.0:1784584225.185331:0:25083:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1784584225.185346:0:25083:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff98b434088000) 00000020:00000080:3.0:1784584225.185364:0:25083:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000100:00100000:0.0:1784584225.186460:0:24895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4105f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3639:x1871271599256576:12345-0@lo:400:kworker.0 Request processed in 2665us (3591us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584225.186487:0:24895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000004:3.0:1784584225.186643:0:25083:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98b302b3b000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1784584225.186648:0:25083:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98b302b3b000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1784584225.186651:0:25083:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98b302b3b000 3 00010000:00080000:3.0:1784584225.186684:0:25083:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98b3037c8800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.151@tcp at head 00010000:00010000:3.0:1784584225.192893:0:25083:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1784584225.193011:0:25083:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1784584225.193069:0:25083:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784584225.193082:0:25083:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xdab2421a42e495e5 00000100:00080000:3.0:1784584225.193091:0:25083:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784584225.193096:0:25083:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff98b3037c8800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:3.0:1784584225.193128:0:25083:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b4105f7b80 x1871271599257216/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784584225.193367:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4105f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1871271599257216:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784584225.193451:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784584225.194017:0:25083:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1784584225.194317:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784584225.194322:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784584225.194325:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784584225.194328:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784584225.195183:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599257216 00000100:00100000:0.0:1784584225.195193:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599257216 00000100:00100000:0.0:1784584225.195235:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784584225.195244:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1871271599257216:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1784584225.195275:0:22749:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 668 last 0 00000020:00000080:0.0:1784584225.195331:0:22749:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xdab2421a42e495ec 00000004:00100000:0.0:1784584225.195351:0:22749:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784584225.195395:0:22749:0:(import.c:65:import_set_state_nolock()) ffff98b437667800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784584225.206557:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1871271599257216:12345-0@lo:38:llog_process_th.0 Request processed in 11301us (13093us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584225.206573:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1784584225.207012:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98b4105f7b80 x1871271599257216/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784584235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584225.207024:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784584225.207033:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1784584225.207406:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1784584225.207413:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1784584225.207417:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b3037c8800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784584225.207425:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4105f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1871271599257216:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1784584225.207610:0:25083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1784584225.207692:0:25069:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1784584225.207730:0:25069:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784584225.207756:0:25069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b800/0xdab2421a42e495bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e495c2 expref: -99 pid: 25069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584225.207768:0:25069:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b800/0xdab2421a42e495bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e495c2 expref: -99 pid: 25069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784584225.207820:0:25069:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784584225.207823:0:25069:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784584225.207824:0:25069:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784584225.207825:0:25069:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784584225.207826:0:25069:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784584225.207828:0:25069:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784584225.207829:0:25069:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784584225.207831:0:25069:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784584225.207833:0:25069:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784584225.207837:0:25069:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1784584225.207840:0:25069:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784584225.207841:0:25069:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784584225.207842:0:25069:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784584225.207844:0:25069:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784584225.207845:0:25069:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784584225.207846:0:25069:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784584225.207852:0:25069:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784584225.207853:0:25069:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784584225.207854:0:25069:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784584225.207878:0:25069:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1784584225.207897:0:25069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efaa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599257344:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784584225.207962:0:25069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584225.208005:0:25069:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43eab1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784584225.208057:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599257344 00000100:00100000:0.0:1784584225.208064:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599257344 00000100:00100000:0.0:1784584225.208297:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784584225.208307:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+24:25069:x1871271599257344:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784584225.208331:0:22740:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1784584225.208345:0:22740:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1784584225.216601:0:22740:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784584225.216619:0:22740:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1784584225.216691:0:22763:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784584225.216695:0:22763:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784584225.216718:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98b303b1d800/0xdab2421a42e495f3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584225.216740:0:22763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b4332b9200/0xdab2421a42e49567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e49560 expref: 24 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584225.216749:0:22763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b418983e00/0xdab2421a42e49575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e4956e expref: 24 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584225.216757:0:22763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98b303b1d800/0xdab2421a42e495f3 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584225.216796:0:22763:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b418983e00/0xdab2421a42e49575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e4956e expref: 24 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584225.216809:0:22763:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b418983e00/0xdab2421a42e49575 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e4956e expref: 24 pid: 22740 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584225.216824:0:22763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efabb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22763:1871271599257472:0@lo:104: 00000100:00100000:1.0:1784584225.216894:0:22763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784584225.216944:0:22763:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b4332b9200/0xdab2421a42e49567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e49560 expref: 24 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584225.216956:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599257472 00000100:00100000:2.0:1784584225.216963:0:22730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599257472 00010000:00010000:1.0:1784584225.216965:0:22763:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b4332b9200/0xdab2421a42e49567 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e49560 expref: 24 pid: 22741 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584225.216973:0:22763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22763:1871271599257600:0@lo:104: 00000100:00100000:1.0:1784584225.216995:0:22763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584225.217012:0:22763:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b418129d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784584225.219565:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+24:25069:x1871271599257344:12345-0@lo:253:mount.lustre.0 Request processed in 11252us (11595us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584225.219580:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784584225.219674:0:25069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efaa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:954867da-9a7c-4a17-b608-74c1de1cda93:25069:1871271599257344:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784584225.219690:0:25069:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1784584225.219693:0:25069:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784584225.219695:0:25069:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784584225.219697:0:25069:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784584225.219698:0:25069:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784584225.219699:0:25069:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784584225.219701:0:25069:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784584225.219702:0:25069:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784584225.219704:0:25069:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784584225.219705:0:25069:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784584225.219719:0:25069:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1784584225.224450:0:22731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599257600 00000100:00100000:3.0:1784584225.224460:0:22731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599257600 00000100:00100000:3.0:1784584225.224517:0:22731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784584225.224529:0:22731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:954867da-9a7c-4a17-b608-74c1de1cda93+4:22763:x1871271599257472:12345-0@lo:104: 00010000:00010000:3.0:1784584225.224546:0:22731:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b303b1c400/0xdab2421a42e4956e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e49575 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584225.224639:0:22731:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784584225.224647:0:22731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:954867da-9a7c-4a17-b608-74c1de1cda93+4:22763:x1871271599257472:12345-0@lo:104: Request processed in 121us (7752us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584225.224660:0:22731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784584225.224683:0:22731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784584225.224688:0:22763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efabb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22763:1871271599257472:0@lo:104: 00000100:00100000:3.0:1784584225.224694:0:22731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:954867da-9a7c-4a17-b608-74c1de1cda93+3:22763:x1871271599257600:12345-0@lo:104: 00010000:00010000:3.0:1784584225.224704:0:22731:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e49560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e49567 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584225.224764:0:22731:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784584225.224770:0:22731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:954867da-9a7c-4a17-b608-74c1de1cda93+3:22763:x1871271599257600:12345-0@lo:104: Request processed in 80us (7773us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584225.224776:0:22731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1784584225.224802:0:22736:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784584225.224808:0:22736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b303b1c400/0xdab2421a42e4956e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e49575 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584225.224816:0:22736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1c400 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:3.0:1784584225.224821:0:22736:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b303b1c400/0xdab2421a42e4956e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e49575 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584225.224830:0:22736:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b303b1c400/0xdab2421a42e4956e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e49575 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784584225.224837:0:22736:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b303b1c400/0xdab2421a42e4956e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e49575 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584225.224843:0:22736:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784584225.224874:0:22735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584225.224880:0:22736:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b303b1c400/0xdab2421a42e4956e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e49575 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584225.224888:0:22736:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784584225.224918:0:22736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b303b1c400/0xdab2421a42e4956e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e49575 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584225.224925:0:22736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b303b1c400/0xdab2421a42e4956e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e49575 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584225.224939:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584225.224941:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584225.224942:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584225.224963:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b4105f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:954867da-9a7c-4a17-b608-74c1de1cda93:3640:1871271599257728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584225.225005:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584225.225056:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599257728 00000100:00100000:3.0:1784584225.225060:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599257728 00010000:00010000:3.0:1784584225.225077:0:22733:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b418983e00/0xdab2421a42e49575 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e4956e expref: 24 pid: 22740 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584225.225097:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784584225.225102:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4105f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:954867da-9a7c-4a17-b608-74c1de1cda93+24:3640:x1871271599257728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784584225.225111:0:22733:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584225.225116:0:22733:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b418983e00/0xdab2421a42e49575 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e4956e expref: 24 pid: 22740 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584225.225126:0:22733:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b418983e00/0xdab2421a42e49575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e4956e expref: 24 pid: 22740 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584225.225139:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b418983e00/0xdab2421a42e49575 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e4956e expref: 24 pid: 22740 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584225.225151:0:22733:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584225.225173:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4105f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:954867da-9a7c-4a17-b608-74c1de1cda93+23:3640:x1871271599257728:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584225.225184:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784584225.225508:0:22763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22763:1871271599257600:0@lo:104: 00010000:00010000:1.0:1784584225.225529:0:22763:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98b303b1d800/0xdab2421a42e495f3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1784584225.231574:0:25069:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1784584225.236484:0:25069:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1784584225.236494:0:25069:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1784584225.236530:0:25069:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784584225.236569:0:25069:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.151@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784584225.236587:0:25069:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1784584225.236604:0:25069:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1784584225.237337:0:25069:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784584225.237616:0:25069:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1784584225.239289:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b4105f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:954867da-9a7c-4a17-b608-74c1de1cda93:3640:1871271599257728:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784584225.239389:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584225.239401:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e49560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e49567 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584225.239423:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982200 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:2.0:1784584225.239427:0:22735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e49560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e49567 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584225.239438:0:22735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e49560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e49567 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784584225.239446:0:22735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e49560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e49567 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584225.239453:0:22735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784584225.239517:0:22735:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e49560 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e49567 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584225.239524:0:22735:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784584225.239546:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e49560 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e49567 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584225.239554:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b418982200/0xdab2421a42e49560 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e49567 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584225.239574:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584225.239577:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584225.239580:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584225.239588:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784584225.239603:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:954867da-9a7c-4a17-b608-74c1de1cda93:3642:1871271599257856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784584225.239670:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784584225.239726:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584225.239729:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584225.240296:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599257856 00000100:00100000:0.0:1784584225.240310:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599257856 00010000:00010000:0.0:1784584225.240338:0:22734:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b4332b9200/0xdab2421a42e49567 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e49560 expref: 23 pid: 22741 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584225.240392:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784584225.240402:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302426d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:954867da-9a7c-4a17-b608-74c1de1cda93+23:3642:x1871271599257856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784584225.240416:0:22734:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584225.240422:0:22734:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b4332b9200/0xdab2421a42e49567 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e49560 expref: 23 pid: 22741 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584225.240433:0:22734:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b4332b9200/0xdab2421a42e49567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e49560 expref: 23 pid: 22741 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584225.240449:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b4332b9200/0xdab2421a42e49567 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e49560 expref: 23 pid: 22741 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584225.240464:0:22734:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98b303b1d800/0xdab2421a42e495f3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584225.240500:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b303b1d800/0xdab2421a42e495f3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784584225.240515:0:22734:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.023819728s 00010000:00010000:0.0:1784584225.240520:0:22734:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b303b1d800/0xdab2421a42e495f3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584225.240527:0:22734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b303b1d800/0xdab2421a42e495f3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584225.240533:0:22734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98b303b1d800/0xdab2421a42e495f3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584225.240551:0:22734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98b303b1d800/0xdab2421a42e495f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584225.240557:0:22734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1d800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:0.0:1784584225.240561:0:22734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98b303b1d800/0xdab2421a42e495f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584225.240570:0:22734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98b303b1d800/0xdab2421a42e495f3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584225.240585:0:22734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98b303b1d800/0xdab2421a42e495f3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584225.240596:0:22734:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584225.240640:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302426d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:954867da-9a7c-4a17-b608-74c1de1cda93+22:3642:x1871271599257856:12345-0@lo:103:ldlm_bl.0 Request processed in 239us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584225.240648:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784584225.240683:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:954867da-9a7c-4a17-b608-74c1de1cda93:3642:1871271599257856:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784584225.240715:0:22763:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98b303b1d800/0xdab2421a42e495f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584225.240723:0:22763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98b303b1d800/0xdab2421a42e495f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584225.240730:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b303b1d800/0xdab2421a42e495f3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584225.786666:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784584226.038402:0:25137:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784584226.038668:0:25137:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1784584226.734667:0:22744:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784584226.734675:0:22744:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98b4049d6000 from 14 10000000:01000000:2.0:1784584226.734680:0:22744:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784584226.734726:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e495fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584226.734738:0:22744:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e495fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584226.734749:0:22744:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e495fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584226.734773:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302425c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599257984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784584226.734841:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584226.734885:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4067afa80 going to sleep for 11 seconds 00000100:00100000:1.0:1784584226.735122:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599257984 00000100:00100000:1.0:1784584226.735130:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599257984 00000100:00100000:1.0:1784584226.735182:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1784584226.735191:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+22:22744:x1871271599257984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784584226.735204:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584226.735217:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b303b1de00/0xdab2421a42e49601 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e495fa expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584226.735240:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b303b1de00/0xdab2421a42e49601 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e495fa expref: 23 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584226.735251:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b303b1de00/0xdab2421a42e49601 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e495fa expref: 23 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584226.735271:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1de00, rc 0) 00000100:00100000:1.0:1784584226.735314:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+23:22744:x1871271599257984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584226.735321:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1784584226.735676:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302425c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599257984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784584226.735692:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e495fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e49601 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584226.735701:0:22744:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e495fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e49601 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584226.735755:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599258112:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784584226.735788:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584226.735819:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41805e300 going to sleep for 11 seconds 00000100:00100000:2.0:1784584226.736118:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599258112 00000100:00100000:2.0:1784584226.736124:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599258112 00000100:00100000:2.0:1784584226.736161:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784584226.736169:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c231c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+23:22744:x1871271599258112:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784584226.736184:0:22740:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784584226.736202:0:22740:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784584226.736205:0:22740:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1784584226.736287:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c231c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+23:22744:x1871271599258112:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584226.736294:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1784584226.738226:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599258112:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784584226.738308:0:22744:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784584226.738319:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e495fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e49601 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584226.738329:0:22744:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b43ea7be00/0xdab2421a42e495fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e49601 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584226.738459:0:22744:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784584226.738463:0:22744:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98b405f11000 from 14 10000000:01000000:1.0:1784584226.738490:0:22744:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784584226.738520:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1d000/0xdab2421a42e49608 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584226.738533:0:22744:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b303b1d000/0xdab2421a42e49608 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584226.738543:0:22744:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b303b1d000/0xdab2421a42e49608 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584226.738562:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599258240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784584226.738614:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584226.738649:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b41805e300 going to sleep for 11 seconds 00000100:00100000:2.0:1784584226.738815:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599258240 00000100:00100000:2.0:1784584226.738821:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599258240 00000100:00100000:2.0:1784584226.738872:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784584226.738882:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+23:22744:x1871271599258240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784584226.738903:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584226.738915:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e4960f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e49608 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584226.738934:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e4960f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e49608 expref: 24 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584226.738944:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ea7a600/0xdab2421a42e4960f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e49608 expref: 24 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584226.738951:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ea7a600, rc 0) 00000100:00100000:2.0:1784584226.741341:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+24:22744:x1871271599258240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2452us (2717us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584226.741352:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1784584226.741694:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599258240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584226.741830:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b303b1d000/0xdab2421a42e49608 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4960f expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584226.741841:0:22744:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b303b1d000/0xdab2421a42e49608 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e4960f expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584226.742804:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599258368:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1784584226.742862:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584226.742937:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b303ace780 going to sleep for 11 seconds 00000100:00100000:1.0:1784584226.742983:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599258368 00000100:00100000:1.0:1784584226.742991:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599258368 00000100:00100000:1.0:1784584226.743134:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1784584226.743144:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+24:22744:x1871271599258368:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784584226.743164:0:22741:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784584226.743181:0:22741:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784584226.743184:0:22741:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1784584226.743496:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+24:22744:x1871271599258368:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 324us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584226.743505:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1784584226.743657:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599258368:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1784584226.743715:0:22744:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784584226.743723:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b303b1d000/0xdab2421a42e49608 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4960f expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584226.743733:0:22744:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b303b1d000/0xdab2421a42e49608 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e4960f expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584226.797625:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784584227.247491:0:22782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1784584227.502347:0:23490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23490:1871271599258624:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1784584227.502423:0:23490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584227.502457:0:23490:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584227.502521:0:24255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599258624 00000100:00100000:1.0:1784584227.502527:0:24255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599258624 00000100:00100000:1.0:1784584227.502595:0:24255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784584227.502605:0:24255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23490:x1871271599258624:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1784584227.502658:0:24255:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00080000:1.0:1784584227.502821:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784584227.502928:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599258496:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784584227.502975:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584227.503009:0:24257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599258496 00000100:00100000:0.0:1784584227.503013:0:24257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599258496 00000100:00100000:0.0:1784584227.503159:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784584227.503168:0:24257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3642:x1871271599258496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784584227.503180:0:24257:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 896 free 3923505152 avail 3691982848 00000100:00100000:0.0:1784584227.503221:0:24257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3642:x1871271599258496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584227.503228:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1784584227.503278:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43efabb80 x1871271599258496/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584227.503296:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599258496:0@lo:13:osp-pre-0-1.0 00000001:00080000:2.0:1784584227.551211:0:24250:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:2.0:1784584227.551228:0:24250:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1784584227.551845:0:24255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23490:x1871271599258624:12345-0@lo:5:osp-pre-0-1.0 Request processed in 49236us (49416us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1784584227.551857:0:24255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1784584227.551990:0:23490:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43efa9f80 x1871271599258624/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784584243 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584227.552007:0:23490:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1784584227.552013:0:23490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23490:1871271599258624:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1784584227.552028:0:23490:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:1.0:1784584227.552075:0:23490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23490:1871271599258752:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1784584227.552110:0:23490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584227.552140:0:23490:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b301f8fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584227.552199:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599258752 00000100:00100000:3.0:1784584227.552206:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599258752 00000100:00100000:3.0:1784584227.552254:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784584227.552264:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23490:x1871271599258752:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1784584227.552321:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23490:x1871271599258752:12345-0@lo:900:osp-pre-0-1.0 Request processed in 58us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584227.552328:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784584227.552396:0:23490:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43efa9f80 x1871271599258752/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784584243 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584227.552406:0:23490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23490:1871271599258752:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1784584227.821663:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584228.526344:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784584228.526379:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c8ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599258880:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784584228.526446:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584228.526510:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599258880 00000100:00100000:0.0:1784584228.526517:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599258880 00000100:00100000:0.0:1784584228.526561:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784584228.526570:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599258880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784584228.526600:0:22753:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1784584228.526643:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599258880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584228.526651:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784584228.526689:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c8ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599258880:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784584228.527341:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784584228.527354:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c236680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599259008:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784584228.527402:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584228.527809:0:23818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599259008 00000100:00100000:3.0:1784584228.527816:0:23818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599259008 00000100:00100000:3.0:1784584228.528016:0:23818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784584228.528026:0:23818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599259008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784584228.528056:0:23818:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1784584228.528101:0:23818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599259008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584228.528108:0:23818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784584228.534012:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c236680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599259008:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784584228.851366:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784584229.488619:0:23502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784584229.871480:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584230.318584:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784584210/real 1784584210] req@ffff98b437690380 x1871271599244800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584230 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584230.318616:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98b437690380 x1871271599244800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584230 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584230.318627:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784584210/real 1784584210] req@ffff98b437690a80 x1871271599244928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584230 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584230.318639:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98b437690a80 x1871271599244928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584230 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784584230.318667:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b416bde800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784584230.318682:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1784584230.318687:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599244800:0@lo:8:kworker.0 00000100:00080000:1.0:1784584230.318693:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b3041fd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784584230.318713:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1784584230.318722:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b437690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599244928:0@lo:8:kworker.0 00000100:00080000:1.0:1784584230.318833:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784584230.318837:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1784584230.318839:0:38:0:(import.c:65:import_set_state_nolock()) ffff98b416bde800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784584230.318844:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 653 00000100:00080000:1.0:1784584230.318849:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1784584230.318856:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98b416bde800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:1.0:1784584230.318875:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b43efabb80 x1871271599259392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784584230.318886:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784584230.318889:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1784584230.318891:0:38:0:(import.c:65:import_set_state_nolock()) ffff98b3041fd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784584230.318894:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 653 00000100:00080000:1.0:1784584230.318896:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1784584230.318899:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98b3041fd000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:1.0:1784584230.318909:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b43efa8e00 x1871271599259520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784584230.318949:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784584230.318952:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1784584230.318954:0:38:0:(import.c:65:import_set_state_nolock()) ffff98b43e810800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784584230.318958:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98b43e810800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:1.0:1784584230.318968:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98b302b45500 x1871271599260032/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784584230.319164:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599259776:0@lo:400:kworker.0 00000100:00100000:2.0:1784584230.319232:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584230.319264:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784584230.319269:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599259648:0@lo:400:kworker.0 00000100:00100000:2.0:1784584230.319291:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584230.319325:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599259776 00000100:00100000:2.0:1784584230.319332:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599259776 00000100:00100000:2.0:1784584230.319387:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784584230.319395:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599259776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584230.319443:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599259776:12345-0@lo:400:kworker.0 Request processed in 47us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584230.319451:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:954867da-9a7c-4a17-b608-74c1de1cda93:3641:1871271599259136:0@lo:400:kworker.0 00000100:00100000:2.0:1784584230.319452:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784584230.319491:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599259648 00000100:00100000:2.0:1784584230.319495:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599259648 00000100:00100000:3.0:1784584230.319514:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584230.319526:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784584230.319538:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599259648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584230.319555:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599259904:0@lo:400:kworker.0 00000100:00100000:2.0:1784584230.319580:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599259648:12345-0@lo:400:kworker.0 Request processed in 45us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584230.319589:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784584230.319608:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584230.319615:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1871271599260416:0@lo:400:kworker.0 00000100:00100000:3.0:1784584230.319640:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599260544:0@lo:400:kworker.0 00000100:00100000:1.0:1784584230.319640:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599259392:0@lo:8:kworker.0 00000100:00100000:2.0:1784584230.319648:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1784584230.319685:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43efaa300 x1871271599259648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584230.319694:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584230.319701:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584230.319704:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599259648:0@lo:400:kworker.0 00000100:00100000:2.0:1784584230.319719:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599259776:0@lo:400:kworker.0 00000100:00100000:3.0:1784584230.319734:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784584230.319744:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599259264:0@lo:400:kworker.0 00000100:00100000:2.0:1784584230.319744:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784584230.319753:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43efa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599259520:0@lo:8:kworker.0 00000100:00100000:2.0:1784584230.319756:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599260288:0@lo:400:kworker.0 00000100:00100000:0.0:1784584230.319883:0:24254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599259904 00000100:00100000:0.0:1784584230.319889:0:24254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599259904 00000100:00100000:0.0:1784584230.319922:0:24254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599259392 00000100:00100000:0.0:1784584230.319926:0:24254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599259392 00000100:00100000:0.0:1784584230.319942:0:24254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784584230.319949:0:24254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4105f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599259904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584230.321238:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584230.321306:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599260416 00000100:00100000:2.0:1784584230.321313:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599260416 00000100:00100000:2.0:1784584230.321361:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599260544 00000100:00100000:2.0:1784584230.321374:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599260544 00000100:00100000:2.0:1784584230.321393:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599260288 00000100:00100000:2.0:1784584230.321396:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599260288 00000100:00100000:2.0:1784584230.321413:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784584230.321420:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871271599260416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584230.321485:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871271599260416:12345-0@lo:400:kworker.0 Request processed in 65us (1841us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584230.321492:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784584230.321507:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784584230.321513:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4105f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599260544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584230.321540:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4105f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599260544:12345-0@lo:400:kworker.0 Request processed in 27us (1850us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584230.321546:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784584230.321556:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784584230.321562:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599260288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584230.321586:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599260288:12345-0@lo:400:kworker.0 Request processed in 25us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584230.321592:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1784584230.321607:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784584230.321611:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784584230.321613:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784584230.321643:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302b44700 x1871271599260288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584230.321656:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599260288:0@lo:400:kworker.0 00010000:00080000:2.0:1784584230.321669:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302b45c00 x1871271599260416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584230.321688:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1871271599260416:0@lo:400:kworker.0 00000100:00100000:3.0:1784584230.323132:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584230.323170:0:24895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784584230.323181:0:24895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3638:x1871271599259392:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1784584230.323188:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599260160:0@lo:400:kworker.0 00010000:00080000:2.0:1784584230.323218:0:24895:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 673 last 0 00000020:00000080:2.0:1784584230.323254:0:24895:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdab2421a42e49616 00002000:00100000:2.0:1784584230.323270:0:24895:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98b302472000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136b7 ocd_grant: 0 ocd_index: 0 ocd_group 0 00000100:00100000:3.0:1784584230.323275:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1784584230.323277:0:24895:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1784584230.323281:0:24895:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1784584230.323302:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599260672:0@lo:400:kworker.0 00000100:00100000:3.0:1784584230.323332:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1784584230.323374:0:24895:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00010000:00080000:3.0:1784584230.323381:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302b47800 x1871271599260544/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584230.323395:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599260544:0@lo:400:kworker.0 00000100:00080000:2.0:1784584230.323400:0:24895:0:(import.c:65:import_set_state_nolock()) ffff98b302475000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784584230.323427:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599260160 00000100:00100000:3.0:1784584230.323434:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599260160 00000100:00100000:2.0:1784584230.323451:0:24895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3638:x1871271599259392:12345-0@lo:8:kworker.0 Request processed in 271us (3750us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584230.323460:0:24895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784584230.323484:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599260672 00000100:00100000:3.0:1784584230.323488:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599260672 00000100:00100000:2.0:1784584230.323505:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599259136 00000100:00100000:2.0:1784584230.323510:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599259136 00000100:00100000:3.0:1784584230.323523:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784584230.323533:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599260160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584230.323546:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1784584230.323555:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+24:3641:x1871271599259136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584230.323579:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871271599260160:12345-0@lo:400:kworker.0 Request processed in 48us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584230.323598:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+24:3641:x1871271599259136:12345-0@lo:400:kworker.0 Request processed in 44us (4085us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584230.323604:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1784584230.323634:0:23818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599259264 00000100:00100000:2.0:1784584230.323638:0:23818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599259264 00000100:00100000:2.0:1784584230.323658:0:23818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784584230.323664:0:23818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4105f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599259264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584230.323692:0:23818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4105f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599259264:12345-0@lo:400:kworker.0 Request processed in 28us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584230.323704:0:23818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784584230.324106:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784584230.324123:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784584230.324131:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599260672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584230.324166:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871271599260672:12345-0@lo:400:kworker.0 Request processed in 36us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584230.324171:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1784584230.324207:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784584230.324232:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599259264:0@lo:400:kworker.0 00010000:00080000:3.0:1784584230.324264:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302b47b80 x1871271599260160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584230.324274:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871271599260160:0@lo:400:kworker.0 00010000:00080000:3.0:1784584230.324284:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302b45880 x1871271599260672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584230.324290:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1871271599260672:0@lo:400:kworker.0 00000100:00100000:3.0:1784584230.324299:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:954867da-9a7c-4a17-b608-74c1de1cda93:3641:1871271599259136:0@lo:400:kworker.0 00000100:00100000:0.0:1784584230.324743:0:24254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4105f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599259904:12345-0@lo:400:kworker.0 Request processed in 4793us (5135us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584230.324753:0:24254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1784584230.324888:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302b47100 x1871271599259904/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584230.324900:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599259904:0@lo:400:kworker.0 00000100:00100000:1.0:1784584230.324954:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584230.325247:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599260032:0@lo:8:kworker.0 00000100:00100000:1.0:1784584230.325492:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1784584230.325533:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43efabb80 x1871271599259392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784584255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584230.325543:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784584230.325551:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1784584230.325559:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784584230.325564:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1784584230.325568:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b416bde800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784584230.325581:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784584230.325587:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599259392:0@lo:8:kworker.0 00000004:00080000:1.0:1784584230.325612:0:22771:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784584230.325700:0:22771:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 673511231604ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784584230.325706:0:22771:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1784584230.327890:0:24895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599259520 00000100:00100000:3.0:1784584230.327903:0:24895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599259520 00000100:00100000:3.0:1784584230.327942:0:24895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599260032 00000100:00100000:3.0:1784584230.327946:0:24895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599260032 00000100:00100000:3.0:1784584230.327970:0:24895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784584230.327979:0:24895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3638:x1871271599259520:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1784584230.328017:0:24895:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 673 last 0 00000020:00000080:3.0:1784584230.328053:0:24895:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdab2421a42e4961d 00002000:00100000:3.0:1784584230.328071:0:24895:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98b3037cb000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136b7 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1784584230.328075:0:24895:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1784584230.328078:0:24895:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1784584230.328242:0:24895:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1784584230.328281:0:24895:0:(import.c:65:import_set_state_nolock()) ffff98b3037cf000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784584230.328381:0:24895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3638:x1871271599259520:12345-0@lo:8:kworker.0 Request processed in 401us (3427us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584230.328396:0:24895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784584230.328411:0:24895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784584230.328415:0:24895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3638:x1871271599260032:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1784584230.328430:0:24895:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 673 last 0 00000020:00000080:3.0:1784584230.328446:0:24895:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdab2421a42e49624 00002000:00100000:3.0:1784584230.328455:0:24895:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff98b3037c9000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136b7 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1784584230.328458:0:24895:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1784584230.328460:0:24895:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1784584230.328513:0:24895:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1784584230.328530:0:24895:0:(import.c:65:import_set_state_nolock()) ffff98b3037cd000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784584230.328567:0:24895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3638:x1871271599260032:12345-0@lo:8:kworker.0 Request processed in 149us (3075us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584230.328574:0:24895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000004:00080000:2.0:1784584230.328606:0:22772:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:2.0:1784584230.328630:0:22772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302424700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22772:1871271599260928:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1784584230.328674:0:22772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584230.328695:0:22772:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b42032ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1784584230.328712:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599260800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784584230.328736:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584230.328773:0:24257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599260800 00000100:00100000:2.0:1784584230.328777:0:24257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599260800 00000100:00100000:3.0:1784584230.328798:0:24895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599260928 00000100:00100000:3.0:1784584230.328804:0:24895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599260928 00000100:00100000:2.0:1784584230.328817:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784584230.328831:0:24895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784584230.328839:0:24895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302425c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:22772:x1871271599260928:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1784584230.328898:0:24257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1871271599260800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784584230.328929:0:24257:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00010000:00080000:3.0:1784584230.329081:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43efa8e00 x1871271599259520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784584255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584230.329092:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784584230.329100:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1784584230.329107:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1784584230.329112:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1784584230.329115:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b3041fd000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1784584230.329128:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1784584230.329141:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43efa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1871271599259520:0@lo:8:kworker.0 00010000:00080000:3.0:1784584230.329158:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302b45500 x1871271599260032/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784584255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784584230.329168:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1784584230.329174:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1784584230.329176:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1784584230.329178:0:3638:0:(import.c:65:import_set_state_nolock()) ffff98b43e810800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1784584230.329189:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1784584230.329194:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1871271599260032:0@lo:8:kworker.0 00000100:00100000:2.0:1784584230.329224:0:24257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1871271599260800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 397us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584230.329233:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000004:00080000:3.0:1784584230.329248:0:22774:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000004:00080000:2.0:1784584230.329284:0:23492:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1784584230.329304:0:23492:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b47100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23492:1871271599261312:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1784584230.329337:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bc0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22774:1871271599261440:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1784584230.329339:0:23492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1784584230.329437:0:22773:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1784584230.329520:0:22773:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 673515051531ns, next at 0ns, rc = 0 00080000:00080000:0.0:1784584230.329527:0:22773:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1784584230.329544:0:23491:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1784584230.329582:0:23491:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 673515113376ns, next at 0ns, rc = 0 00080000:00080000:0.0:1784584230.329723:0:23491:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1784584230.333537:0:22727:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1784584230.334647:0:22727:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00080000:2.0:1784584230.338676:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302426300 x1871271599260800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584246 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584230.338705:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599260800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784584230.338731:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784584230.338742:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599261056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784584230.338802:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584230.338857:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784584230.338866:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599261184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784584230.338903:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584230.338941:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599261056 00000100:00100000:1.0:1784584230.338994:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584230.339029:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4024516c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584230.339223:0:24258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599261056 00000100:00100000:2.0:1784584230.339268:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599261184 00000100:00100000:2.0:1784584230.339272:0:24258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599261184 00000100:00100000:2.0:1784584230.339289:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784584230.339297:0:24258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1871271599261056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784584230.339324:0:24258:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1784584230.339385:0:24258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1871271599261056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584230.339393:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784584230.339409:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784584230.339414:0:24258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1871271599261184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784584230.339423:0:24258:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1784584230.339455:0:24258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1871271599261184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584230.339461:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1784584230.339505:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784584230.339509:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784584230.339527:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302b45500 x1871271599261184/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584246 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584230.339542:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599261184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784584230.339563:0:23492:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b42032b900 going to sleep for 11 seconds 00000100:00100000:3.0:1784584230.339665:0:24253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599261312 00000100:00100000:3.0:1784584230.339670:0:24253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599261312 00000100:00100000:3.0:1784584230.339698:0:24253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599261440 00000100:00100000:3.0:1784584230.339701:0:24253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599261440 00000100:00100000:3.0:1784584230.339715:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784584230.339723:0:24253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23492:x1871271599261312:12345-0@lo:7:osp-pre-1-1.0 00010000:00080000:1.0:1784584230.340075:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303bc1500 x1871271599261056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584246 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584230.340090:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599261056:0@lo:13:osp-pre-1-0.0 00002000:00080000:1.0:1784584230.342135:0:24895:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1784584230.342146:0:24895:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:1.0:1784584230.342152:0:24895:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:65) 00002000:00080000:3.0:1784584230.343702:0:24253:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1784584230.343711:0:24253:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1784584230.343798:0:24253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23492:x1871271599261312:12345-0@lo:7:osp-pre-1-1.0 Request processed in 4071us (14457us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584230.343808:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784584230.343840:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784584230.343851:0:24253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22774:x1871271599261440:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1784584230.344432:0:23481:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00010000:00080000:0.0:1784584230.346410:0:23492:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b302b47100 x1871271599261312/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784584246 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584230.346429:0:23492:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b47100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23492:1871271599261312:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1784584230.346444:0:23492:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1784584230.346504:0:23492:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c236680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23492:1871271599261568:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1784584230.346565:0:23492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1784584230.347397:0:24253:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1784584230.347407:0:24253:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1784584230.347421:0:24253:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00000100:00100000:0.0:1784584230.348380:0:23492:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cba1000 going to sleep for 11 seconds 00002000:00010000:1.0:1784584230.360853:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784584230.360864:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfecb9db/0xdab2421a42e4962b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.360881:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=673s v=(0 0) 00010000:00010000:1.0:1784584230.360886:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584230.360892:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfecb9db/0xdab2421a42e4962b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.360909:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfecb9db/0xdab2421a42e4962b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.360933:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfecb9db/0xdab2421a42e4962b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.360939:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfecb9db/0xdab2421a42e4962b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.360967:0:24895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784584230.365608:0:25088:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784584230.365625:0:25088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfecb9db/0xdab2421a42e4962b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.365640:0:25088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1c000 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:0.0:1784584230.365645:0:25088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfecb9db/0xdab2421a42e4962b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.365657:0:25088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfecb9db/0xdab2421a42e4962b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.365696:0:25088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfecb9db/0xdab2421a42e4962b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.365706:0:25088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfecb9db/0xdab2421a42e4962b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.365734:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584230.365736:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584230.365738:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784584230.374416:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784584230.374430:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001423bbeb/0xdab2421a42e49632 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.374448:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=673s v=(0 0) 00010000:00010000:1.0:1784584230.374488:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584230.374498:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001423bbeb/0xdab2421a42e49632 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.374514:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001423bbeb/0xdab2421a42e49632 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.374525:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001423bbeb/0xdab2421a42e49632 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.374534:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001423bbeb/0xdab2421a42e49632 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.374552:0:24895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784584230.374766:0:22736:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584230.374772:0:22736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001423bbeb/0xdab2421a42e49632 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.374781:0:22736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1d400 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:1.0:1784584230.374786:0:22736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001423bbeb/0xdab2421a42e49632 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.374796:0:22736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001423bbeb/0xdab2421a42e49632 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.374815:0:22736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001423bbeb/0xdab2421a42e49632 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.374834:0:22736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001423bbeb/0xdab2421a42e49632 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.374852:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584230.374854:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584230.374856:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584230.379582:0:24255:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1784584230.379597:0:24255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00002000:00010000:1.0:1784584230.380834:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784584230.380848:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fbb221b/0xdab2421a42e49639 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.380867:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=673s v=(0 0) 00010000:00010000:1.0:1784584230.380872:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584230.380880:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fbb221b/0xdab2421a42e49639 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.380895:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fbb221b/0xdab2421a42e49639 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.380906:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fbb221b/0xdab2421a42e49639 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.380913:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fbb221b/0xdab2421a42e49639 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.380935:0:24895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784584230.381401:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784584230.381415:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af39117a/0xdab2421a42e49640 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.381423:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=673s v=(0 0) 00010000:00010000:1.0:1784584230.381427:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584230.381431:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af39117a/0xdab2421a42e49640 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.381440:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af39117a/0xdab2421a42e49640 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.381447:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af39117a/0xdab2421a42e49640 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.381454:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af39117a/0xdab2421a42e49640 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.381492:0:24895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784584230.381757:0:25088:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784584230.381765:0:25088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fbb221b/0xdab2421a42e49639 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.381774:0:25088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1c800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:0.0:1784584230.381779:0:25088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fbb221b/0xdab2421a42e49639 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.381788:0:25088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fbb221b/0xdab2421a42e49639 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.381806:0:25088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fbb221b/0xdab2421a42e49639 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.381813:0:25088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fbb221b/0xdab2421a42e49639 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.381846:0:25088:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784584230.381850:0:25088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af39117a/0xdab2421a42e49640 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.381857:0:25088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1d800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:0.0:1784584230.381860:0:25088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af39117a/0xdab2421a42e49640 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.381868:0:25088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af39117a/0xdab2421a42e49640 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.381878:0:25088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af39117a/0xdab2421a42e49640 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.381885:0:25088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af39117a/0xdab2421a42e49640 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.381899:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584230.381901:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584230.381902:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584230.382223:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584230.382254:0:24255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599261568 00000100:00100000:2.0:1784584230.382263:0:24255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599261568 00000100:00100000:2.0:1784584230.382392:0:25386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784584230.382401:0:25386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23492:x1871271599261568:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1784584230.382434:0:25386:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1784584230.382525:0:25386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23492:x1871271599261568:12345-0@lo:5:osp-pre-1-1.0 Request processed in 125us (35959us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584230.382534:0:25386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1784584230.382654:0:23492:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43c236680 x1871271599261568/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784584246 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584230.382670:0:23492:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c236680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23492:1871271599261568:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1784584230.382683:0:23492:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1784584230.382737:0:23492:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c236680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23492:1871271599261696:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1784584230.382772:0:23492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584230.382804:0:23492:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cba1000 going to sleep for 11 seconds 00002000:00010000:3.0:1784584230.383343:0:24253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584230.383365:0:24253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cabb152/0xdab2421a42e49647 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.383377:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1784584230.383381:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584230.383387:0:24253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cabb152/0xdab2421a42e49647 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.383402:0:24253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cabb152/0xdab2421a42e49647 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.383423:0:24253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cabb152/0xdab2421a42e49647 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.383431:0:24253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cabb152/0xdab2421a42e49647 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.383452:0:24253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584230.383462:0:22736:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584230.383490:0:22736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cabb152/0xdab2421a42e49647 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.383498:0:22736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418983e00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584230.383502:0:22736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cabb152/0xdab2421a42e49647 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.383525:0:22736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cabb152/0xdab2421a42e49647 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.383537:0:22736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cabb152/0xdab2421a42e49647 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.383544:0:22736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cabb152/0xdab2421a42e49647 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.383561:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.383562:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.383564:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784584230.384692:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584230.384712:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098c9684e/0xdab2421a42e4964e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.384724:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1784584230.384728:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584230.384747:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098c9684e/0xdab2421a42e4964e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.384761:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098c9684e/0xdab2421a42e4964e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.384771:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098c9684e/0xdab2421a42e4964e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.384787:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098c9684e/0xdab2421a42e4964e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.384805:0:24895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584230.385194:0:25088:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584230.385200:0:25088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098c9684e/0xdab2421a42e4964e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.385208:0:25088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418983800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584230.385212:0:25088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098c9684e/0xdab2421a42e4964e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.385220:0:25088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098c9684e/0xdab2421a42e4964e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.385233:0:25088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098c9684e/0xdab2421a42e4964e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.385240:0:25088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098c9684e/0xdab2421a42e4964e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.385256:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.385258:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.385260:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584230.385455:0:24255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599261696 00000100:00100000:2.0:1784584230.385464:0:24255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599261696 00000100:00100000:2.0:1784584230.385524:0:24255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784584230.385533:0:24255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c234700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23492:x1871271599261696:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1784584230.385570:0:24255:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:3.0:1784584230.385631:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584230.385647:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b367b980/0xdab2421a42e49655 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.385656:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1784584230.385660:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584230.385665:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b367b980/0xdab2421a42e49655 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.385677:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b367b980/0xdab2421a42e49655 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.385686:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b367b980/0xdab2421a42e49655 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.385693:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b367b980/0xdab2421a42e49655 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.385723:0:24895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584230.385771:0:22735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584230.385778:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b367b980/0xdab2421a42e49655 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.385787:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:2.0:1784584230.385790:0:22735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b367b980/0xdab2421a42e49655 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.385798:0:22735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b367b980/0xdab2421a42e49655 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.385813:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b367b980/0xdab2421a42e49655 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.385832:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b367b980/0xdab2421a42e49655 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.385848:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584230.385850:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584230.385852:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784584230.386285:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584230.386292:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071527049/0xdab2421a42e4965c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.386301:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1784584230.386305:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584230.386309:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071527049/0xdab2421a42e4965c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.386319:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071527049/0xdab2421a42e4965c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.386334:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071527049/0xdab2421a42e4965c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.386341:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071527049/0xdab2421a42e4965c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.386374:0:24895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784584230.386458:0:24253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784584230.386480:0:24253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9419e27/0xdab2421a42e49663 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.386489:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=673s v=(0 0) 00010000:00010000:1.0:1784584230.386492:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584230.386496:0:24253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9419e27/0xdab2421a42e49663 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.386507:0:24253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9419e27/0xdab2421a42e49663 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.386520:0:24253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9419e27/0xdab2421a42e49663 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.386528:0:24253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9419e27/0xdab2421a42e49663 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.386542:0:24253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784584230.386610:0:25088:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784584230.386616:0:25088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071527049/0xdab2421a42e4965c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.386625:0:25088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418983400 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584230.386629:0:25088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071527049/0xdab2421a42e4965c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.386638:0:25088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071527049/0xdab2421a42e4965c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.386652:0:25088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071527049/0xdab2421a42e4965c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.386660:0:25088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071527049/0xdab2421a42e4965c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.386675:0:25088:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584230.386685:0:25088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9419e27/0xdab2421a42e49663 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.386693:0:25088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1c400 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:2.0:1784584230.386694:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.386704:0:25088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9419e27/0xdab2421a42e49663 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.386714:0:25088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9419e27/0xdab2421a42e49663 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.386725:0:25088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9419e27/0xdab2421a42e49663 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.387637:0:25088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9419e27/0xdab2421a42e49663 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.387660:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.387662:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.387663:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784584230.388245:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584230.388254:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000473d624f/0xdab2421a42e4966a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.388266:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1784584230.388270:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584230.388276:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000473d624f/0xdab2421a42e4966a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.388301:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000473d624f/0xdab2421a42e4966a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.388311:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000473d624f/0xdab2421a42e4966a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.388319:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000473d624f/0xdab2421a42e4966a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.388337:0:24895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584230.388435:0:22735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584230.388442:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000473d624f/0xdab2421a42e4966a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.388451:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418982200 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:2.0:1784584230.388455:0:22735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000473d624f/0xdab2421a42e4966a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.388464:0:22735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000473d624f/0xdab2421a42e4966a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.388491:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000473d624f/0xdab2421a42e4966a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.388497:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000473d624f/0xdab2421a42e4966a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.388513:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584230.388515:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584230.388525:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784584230.388773:0:24253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584230.388778:0:24253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa1abc31/0xdab2421a42e49671 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.388788:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=673s v=(0 0) 00010000:00010000:2.0:1784584230.388792:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584230.388796:0:24253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa1abc31/0xdab2421a42e49671 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.388806:0:24253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa1abc31/0xdab2421a42e49671 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.388815:0:24253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa1abc31/0xdab2421a42e49671 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.388822:0:24253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa1abc31/0xdab2421a42e49671 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.388844:0:24253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784584230.388960:0:22736:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584230.388965:0:22736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa1abc31/0xdab2421a42e49671 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.388973:0:22736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7b000 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:1.0:1784584230.388976:0:22736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa1abc31/0xdab2421a42e49671 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.388984:0:22736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa1abc31/0xdab2421a42e49671 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.388994:0:22736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa1abc31/0xdab2421a42e49671 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.389001:0:22736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa1abc31/0xdab2421a42e49671 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.389015:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584230.389022:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584230.389024:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784584230.390630:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584230.390643:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e49678 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.390657:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1784584230.390661:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584230.390667:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e49678 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.390680:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e49678 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.390689:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e49678 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.390719:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e49678 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.391108:0:24895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784584230.391574:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584230.391582:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f68436/0xdab2421a42e4967f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.391593:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1784584230.391597:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584230.391601:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f68436/0xdab2421a42e4967f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.391612:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f68436/0xdab2421a42e4967f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.391620:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f68436/0xdab2421a42e4967f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.391627:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f68436/0xdab2421a42e4967f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.391646:0:24895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784584230.392143:0:22735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784584230.392150:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e49678 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.392165:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584230.392170:0:22735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e49678 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.392178:0:22735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e49678 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.392193:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e49678 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.392200:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e49678 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.392216:0:22735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584230.392219:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9f68436/0xdab2421a42e4967f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.392225:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8600 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584230.392227:0:22735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f68436/0xdab2421a42e4967f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.392233:0:22735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f68436/0xdab2421a42e4967f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.392243:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9f68436/0xdab2421a42e4967f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.392257:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f68436/0xdab2421a42e4967f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.392269:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.392272:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.392273:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.392280:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784584230.392630:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584230.392637:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014b02c23/0xdab2421a42e49686 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.392647:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1784584230.392651:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584230.392656:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014b02c23/0xdab2421a42e49686 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.392667:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014b02c23/0xdab2421a42e49686 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.392676:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014b02c23/0xdab2421a42e49686 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.392684:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014b02c23/0xdab2421a42e49686 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.392712:0:24895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784584230.393378:0:22736:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584230.393386:0:22736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014b02c23/0xdab2421a42e49686 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.393396:0:22736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8200 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:1.0:1784584230.393401:0:22736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014b02c23/0xdab2421a42e49686 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.393409:0:22736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014b02c23/0xdab2421a42e49686 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.393423:0:22736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014b02c23/0xdab2421a42e49686 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.393430:0:22736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014b02c23/0xdab2421a42e49686 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.393446:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584230.393448:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584230.393449:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784584230.394784:0:24253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784584230.394795:0:24253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000456cd055/0xdab2421a42e4968d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.394808:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=673s v=(0 0) 00010000:00010000:0.0:1784584230.394811:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584230.394817:0:24253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000456cd055/0xdab2421a42e4968d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.394830:0:24253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000456cd055/0xdab2421a42e4968d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.394838:0:24253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000456cd055/0xdab2421a42e4968d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.394846:0:24253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000456cd055/0xdab2421a42e4968d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.395063:0:24253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584230.395552:0:22735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584230.395560:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000456cd055/0xdab2421a42e4968d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.395571:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4332b9600 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584230.395576:0:22735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000456cd055/0xdab2421a42e4968d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.395586:0:22735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000456cd055/0xdab2421a42e4968d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.395603:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000456cd055/0xdab2421a42e4968d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.395611:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000456cd055/0xdab2421a42e4968d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.395631:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.395634:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.395635:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784584230.396633:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584230.396643:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f45b9413/0xdab2421a42e49694 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.396655:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1784584230.396659:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584230.396665:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f45b9413/0xdab2421a42e49694 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.396692:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f45b9413/0xdab2421a42e49694 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.396702:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f45b9413/0xdab2421a42e49694 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.396710:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f45b9413/0xdab2421a42e49694 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.396745:0:24895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784584230.397035:0:25088:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784584230.397043:0:25088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f45b9413/0xdab2421a42e49694 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.397052:0:25088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8a00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:0.0:1784584230.397061:0:25088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f45b9413/0xdab2421a42e49694 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.397070:0:25088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f45b9413/0xdab2421a42e49694 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.397083:0:25088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f45b9413/0xdab2421a42e49694 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.397090:0:25088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f45b9413/0xdab2421a42e49694 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.397105:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584230.397107:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584230.397109:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784584230.397334:0:24253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784584230.397341:0:24253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001423bbeb/0xdab2421a42e4969b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.397363:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=673s v=(0 0) 00010000:00010000:1.0:1784584230.397367:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584230.397378:0:24253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001423bbeb/0xdab2421a42e4969b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.397389:0:24253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001423bbeb/0xdab2421a42e4969b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.397397:0:24253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001423bbeb/0xdab2421a42e4969b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.397405:0:24253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001423bbeb/0xdab2421a42e4969b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.397422:0:24253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584230.397866:0:22736:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584230.397872:0:22736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001423bbeb/0xdab2421a42e4969b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.397882:0:22736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1d400 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584230.397886:0:22736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001423bbeb/0xdab2421a42e4969b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.397894:0:22736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001423bbeb/0xdab2421a42e4969b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.397909:0:22736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001423bbeb/0xdab2421a42e4969b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.397916:0:22736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001423bbeb/0xdab2421a42e4969b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.397942:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.397945:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.397947:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784584230.398247:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584230.398254:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bcddd67/0xdab2421a42e496a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.398264:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=673s v=(0 0) 00010000:00010000:2.0:1784584230.398268:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584230.398272:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bcddd67/0xdab2421a42e496a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.398294:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bcddd67/0xdab2421a42e496a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.398302:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bcddd67/0xdab2421a42e496a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.398309:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007bcddd67/0xdab2421a42e496a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.398321:0:24895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584230.398560:0:22735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584230.398565:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007bcddd67/0xdab2421a42e496a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.398574:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7b600 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584230.398577:0:22735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007bcddd67/0xdab2421a42e496a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.398586:0:22735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007bcddd67/0xdab2421a42e496a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.398598:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007bcddd67/0xdab2421a42e496a2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.398607:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bcddd67/0xdab2421a42e496a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.398626:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.398628:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.398631:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784584230.398677:0:24253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584230.398684:0:24253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9f68436/0xdab2421a42e496a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.398704:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1784584230.398708:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584230.398713:0:24253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9f68436/0xdab2421a42e496a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.398723:0:24253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9f68436/0xdab2421a42e496a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784584230.399219:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584230.399225:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa1abc31/0xdab2421a42e496b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.399235:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=673s v=(0 0) 00010000:00010000:2.0:1784584230.399238:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584230.399243:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa1abc31/0xdab2421a42e496b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.399253:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa1abc31/0xdab2421a42e496b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.399261:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa1abc31/0xdab2421a42e496b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.399280:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa1abc31/0xdab2421a42e496b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.399300:0:24895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784584230.399306:0:25088:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784584230.399312:0:25088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa1abc31/0xdab2421a42e496b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.399320:0:25088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7b000 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:0.0:1784584230.399324:0:25088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa1abc31/0xdab2421a42e496b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.399332:0:25088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa1abc31/0xdab2421a42e496b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.399343:0:25088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa1abc31/0xdab2421a42e496b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.399370:0:25088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa1abc31/0xdab2421a42e496b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.399386:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584230.399388:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584230.399390:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784584230.399766:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584230.399773:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a27a3b69/0xdab2421a42e496b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.399782:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=673s v=(0 0) 00010000:00010000:2.0:1784584230.399785:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584230.399789:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a27a3b69/0xdab2421a42e496b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.399799:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a27a3b69/0xdab2421a42e496b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.399807:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a27a3b69/0xdab2421a42e496b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.399814:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a27a3b69/0xdab2421a42e496b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.399829:0:24895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784584230.400203:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584230.400209:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000420ab313/0xdab2421a42e496be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.400223:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=673s v=(0 0) 00010000:00010000:2.0:1784584230.400226:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584230.400231:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000420ab313/0xdab2421a42e496be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.400240:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000420ab313/0xdab2421a42e496be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.400249:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000420ab313/0xdab2421a42e496be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.400255:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000420ab313/0xdab2421a42e496be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.400279:0:24895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784584230.400501:0:24253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9f68436/0xdab2421a42e496a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.400512:0:24253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9f68436/0xdab2421a42e496a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.400519:0:22735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784584230.400526:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a27a3b69/0xdab2421a42e496b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.400536:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1200 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:2.0:1784584230.400540:0:22735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a27a3b69/0xdab2421a42e496b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.400545:0:24253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784584230.400549:0:22735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a27a3b69/0xdab2421a42e496b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.400555:0:25088:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784584230.400560:0:25088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000420ab313/0xdab2421a42e496be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.400580:0:25088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1c00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584230.400584:0:25088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000420ab313/0xdab2421a42e496be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.400590:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a27a3b69/0xdab2421a42e496b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.400593:0:25088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000420ab313/0xdab2421a42e496be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.400610:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a27a3b69/0xdab2421a42e496b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.400638:0:25088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000420ab313/0xdab2421a42e496be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.400640:0:22735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584230.400648:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9f68436/0xdab2421a42e496a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.400650:0:25088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000420ab313/0xdab2421a42e496be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.400669:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8600 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:2.0:1784584230.400675:0:22735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9f68436/0xdab2421a42e496a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.400679:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.400682:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.400685:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584230.400687:0:22735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9f68436/0xdab2421a42e496a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.400707:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9f68436/0xdab2421a42e496a9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.400715:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9f68436/0xdab2421a42e496a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.400732:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584230.400734:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584230.400742:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584230.400768:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784584230.401579:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584230.401586:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e496c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.401597:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1784584230.401601:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584230.401606:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e496c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.401618:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e496c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.401627:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e496c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.401634:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e496c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.401662:0:24895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784584230.401753:0:24253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784584230.401761:0:24253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9419e27/0xdab2421a42e496cc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.401770:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=673s v=(0 0) 00010000:00010000:1.0:1784584230.401775:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584230.401779:0:24253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9419e27/0xdab2421a42e496cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.401791:0:24253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9419e27/0xdab2421a42e496cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.401800:0:24253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9419e27/0xdab2421a42e496cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.401820:0:24253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9419e27/0xdab2421a42e496cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.401843:0:24253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784584230.401922:0:22735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784584230.401928:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e496c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.401936:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584230.401939:0:22735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e496c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.401947:0:22735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e496c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.401960:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e496c5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.401967:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7a9acad/0xdab2421a42e496c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.401981:0:22735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584230.401984:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9419e27/0xdab2421a42e496cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.401990:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1c400 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584230.401993:0:22735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9419e27/0xdab2421a42e496cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.402013:0:22735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9419e27/0xdab2421a42e496cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.402024:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9419e27/0xdab2421a42e496cc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.402031:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9419e27/0xdab2421a42e496cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.402044:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.402046:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.402047:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784584230.402148:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584230.402150:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.402157:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000043fd96b/0xdab2421a42e496d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.402166:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1784584230.402169:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584230.402174:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000043fd96b/0xdab2421a42e496d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.402184:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000043fd96b/0xdab2421a42e496d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.402194:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000043fd96b/0xdab2421a42e496d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.402210:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000043fd96b/0xdab2421a42e496d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.402235:0:24895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584230.402446:0:22736:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584230.402452:0:22736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000043fd96b/0xdab2421a42e496d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.402460:0:22736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9600 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:2.0:1784584230.402464:0:22736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000043fd96b/0xdab2421a42e496d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.402485:0:22736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000043fd96b/0xdab2421a42e496d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.402497:0:22736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000043fd96b/0xdab2421a42e496d3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.402505:0:22736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000043fd96b/0xdab2421a42e496d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.402519:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584230.402521:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584230.402523:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784584230.402861:0:24253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584230.402867:0:24253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016276068/0xdab2421a42e496da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.402876:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=673s v=(0 0) 00010000:00010000:2.0:1784584230.402884:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584230.402889:0:24253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016276068/0xdab2421a42e496da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.402899:0:24253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016276068/0xdab2421a42e496da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.402907:0:24253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016276068/0xdab2421a42e496da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.402915:0:24253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016276068/0xdab2421a42e496da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.402926:0:24253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784584230.403184:0:24253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584230.403190:0:24253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006747af3a/0xdab2421a42e496e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.403199:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=673s v=(0 0) 00010000:00010000:2.0:1784584230.403202:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584230.403207:0:24253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006747af3a/0xdab2421a42e496e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.403216:0:24253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006747af3a/0xdab2421a42e496e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.403224:0:24253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006747af3a/0xdab2421a42e496e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.403238:0:24253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006747af3a/0xdab2421a42e496e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.403251:0:24253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784584230.403258:0:25088:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784584230.403262:0:25088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016276068/0xdab2421a42e496da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.403269:0:25088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0c00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:2.0:1784584230.403273:0:25088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016276068/0xdab2421a42e496da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.403281:0:25088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016276068/0xdab2421a42e496da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.403293:0:25088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016276068/0xdab2421a42e496da lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.403301:0:25088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016276068/0xdab2421a42e496da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.403313:0:25088:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584230.403316:0:25088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006747af3a/0xdab2421a42e496e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.403332:0:25088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0e00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:2.0:1784584230.403336:0:25088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006747af3a/0xdab2421a42e496e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.403343:0:25088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006747af3a/0xdab2421a42e496e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.403366:0:25088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006747af3a/0xdab2421a42e496e1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.403374:0:25088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006747af3a/0xdab2421a42e496e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.403385:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584230.403387:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584230.403389:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.403576:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784584230.403828:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584230.403834:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf6b015/0xdab2421a42e496e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.403844:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=673s v=(0 0) 00010000:00010000:2.0:1784584230.403847:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584230.403852:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf6b015/0xdab2421a42e496e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.403862:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaf6b015/0xdab2421a42e496e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.403875:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf6b015/0xdab2421a42e496e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.403883:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf6b015/0xdab2421a42e496e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.403897:0:24895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584230.403906:0:22736:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584230.403910:0:22736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaf6b015/0xdab2421a42e496e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.403917:0:22736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0a00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:2.0:1784584230.403921:0:22736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf6b015/0xdab2421a42e496e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.403929:0:22736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf6b015/0xdab2421a42e496e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.403940:0:22736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaf6b015/0xdab2421a42e496e8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.403947:0:22736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaf6b015/0xdab2421a42e496e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.403962:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584230.403969:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584230.403972:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784584230.404004:0:24253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584230.404012:0:24253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e7eb1c6/0xdab2421a42e496ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.404023:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1784584230.404027:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584230.404032:0:24253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e7eb1c6/0xdab2421a42e496ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.404043:0:24253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e7eb1c6/0xdab2421a42e496ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.404052:0:24253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e7eb1c6/0xdab2421a42e496ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.404061:0:24253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e7eb1c6/0xdab2421a42e496ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.404077:0:24253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584230.404086:0:25088:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584230.404092:0:25088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e7eb1c6/0xdab2421a42e496ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.404100:0:25088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8400 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:2.0:1784584230.404104:0:25088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e7eb1c6/0xdab2421a42e496ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.404112:0:25088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e7eb1c6/0xdab2421a42e496ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.404124:0:25088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e7eb1c6/0xdab2421a42e496ef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.404132:0:25088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e7eb1c6/0xdab2421a42e496ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.404145:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584230.404147:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584230.404149:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784584230.404420:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584230.404426:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000295b921a/0xdab2421a42e496f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.404434:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=673s v=(0 0) 00010000:00010000:2.0:1784584230.404438:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584230.404449:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000295b921a/0xdab2421a42e496f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.404459:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000295b921a/0xdab2421a42e496f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.404485:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000295b921a/0xdab2421a42e496f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.404493:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000295b921a/0xdab2421a42e496f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.404507:0:24895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584230.404639:0:22735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584230.404650:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000295b921a/0xdab2421a42e496f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.404659:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0200 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584230.404662:0:22735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000295b921a/0xdab2421a42e496f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.404671:0:22735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000295b921a/0xdab2421a42e496f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.404684:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000295b921a/0xdab2421a42e496f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.404691:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000295b921a/0xdab2421a42e496f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.404707:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.404709:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.404711:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784584230.405568:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584230.405577:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054f7bb81/0xdab2421a42e496fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.405640:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=673s v=(0 0) 00010000:00010000:2.0:1784584230.405645:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584230.405651:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054f7bb81/0xdab2421a42e496fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.405664:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054f7bb81/0xdab2421a42e496fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.405672:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054f7bb81/0xdab2421a42e496fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.405690:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054f7bb81/0xdab2421a42e496fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784584230.405753:0:24253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584230.405759:0:24253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001882ffc/0xdab2421a42e49704 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.405768:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1784584230.405771:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584230.405776:0:24253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001882ffc/0xdab2421a42e49704 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.405797:0:24253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001882ffc/0xdab2421a42e49704 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.405899:0:24253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001882ffc/0xdab2421a42e49704 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.405915:0:24253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001882ffc/0xdab2421a42e49704 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.405921:0:24895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584230.405933:0:22736:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584230.405938:0:22736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054f7bb81/0xdab2421a42e496fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.405947:0:22736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0600 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:2.0:1784584230.405951:0:22736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054f7bb81/0xdab2421a42e496fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.405960:0:22736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054f7bb81/0xdab2421a42e496fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.405975:0:22736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054f7bb81/0xdab2421a42e496fd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.405982:0:22736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054f7bb81/0xdab2421a42e496fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.405999:0:22736:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584230.406001:0:24253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784584230.406003:0:22736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001882ffc/0xdab2421a42e49704 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.406011:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584230.406024:0:22736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9200 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:2.0:1784584230.406027:0:22736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001882ffc/0xdab2421a42e49704 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.406035:0:22736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001882ffc/0xdab2421a42e49704 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.406048:0:22736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001882ffc/0xdab2421a42e49704 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.406901:0:22736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001882ffc/0xdab2421a42e49704 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.406918:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584230.406919:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584230.406921:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784584230.407429:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584230.407436:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a27a3b69/0xdab2421a42e4970b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.407447:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=673s v=(0 0) 00010000:00010000:2.0:1784584230.407450:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584230.407456:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a27a3b69/0xdab2421a42e4970b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.407484:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a27a3b69/0xdab2421a42e4970b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.407500:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a27a3b69/0xdab2421a42e4970b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.407507:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a27a3b69/0xdab2421a42e4970b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.407532:0:24895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784584230.407722:0:24253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584230.407728:0:24253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c49d766/0xdab2421a42e49712 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.407835:0:22735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584230.407842:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a27a3b69/0xdab2421a42e4970b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.407850:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1200 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:1.0:1784584230.407854:0:22735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a27a3b69/0xdab2421a42e4970b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.407863:0:22735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a27a3b69/0xdab2421a42e4970b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.407877:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a27a3b69/0xdab2421a42e4970b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.407884:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a27a3b69/0xdab2421a42e4970b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.407898:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584230.407900:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584230.407901:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.407960:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1784584230.407963:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584230.407968:0:24253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c49d766/0xdab2421a42e49712 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.407979:0:24253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c49d766/0xdab2421a42e49712 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.407987:0:24253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c49d766/0xdab2421a42e49712 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.408006:0:24253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c49d766/0xdab2421a42e49712 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.408021:0:24253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584230.408030:0:25088:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584230.408034:0:25088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c49d766/0xdab2421a42e49712 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.408042:0:25088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8000 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584230.408046:0:25088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c49d766/0xdab2421a42e49712 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.408054:0:25088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c49d766/0xdab2421a42e49712 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.408066:0:25088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c49d766/0xdab2421a42e49712 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.408073:0:25088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c49d766/0xdab2421a42e49712 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.408087:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.408089:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.408091:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784584230.408255:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584230.408262:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007346acc9/0xdab2421a42e49719 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.408270:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=673s v=(0 0) 00010000:00010000:2.0:1784584230.408274:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584230.408278:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007346acc9/0xdab2421a42e49719 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.408288:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007346acc9/0xdab2421a42e49719 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.408296:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007346acc9/0xdab2421a42e49719 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.408303:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007346acc9/0xdab2421a42e49719 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.408334:0:24895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584230.408895:0:22736:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584230.408906:0:22736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007346acc9/0xdab2421a42e49719 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.408915:0:22736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1a00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584230.408919:0:22736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007346acc9/0xdab2421a42e49719 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.408927:0:22736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007346acc9/0xdab2421a42e49719 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.408940:0:22736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007346acc9/0xdab2421a42e49719 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.408947:0:22736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007346acc9/0xdab2421a42e49719 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.408963:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.408965:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.408967:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784584230.409015:0:24253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584230.409021:0:24253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2576fa1/0xdab2421a42e49720 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.409031:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1784584230.409035:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584230.409040:0:24253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2576fa1/0xdab2421a42e49720 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.409063:0:24253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2576fa1/0xdab2421a42e49720 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784584230.409066:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584230.409076:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3bb4e74/0xdab2421a42e49727 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.409078:0:24253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2576fa1/0xdab2421a42e49720 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.409096:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1784584230.409098:0:24253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2576fa1/0xdab2421a42e49720 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.409102:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584230.409110:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3bb4e74/0xdab2421a42e49727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.409121:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3bb4e74/0xdab2421a42e49727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.409122:0:24253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584230.409133:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3bb4e74/0xdab2421a42e49727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.409134:0:22735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584230.409142:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2576fa1/0xdab2421a42e49720 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.409146:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3bb4e74/0xdab2421a42e49727 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.409158:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584230.409164:0:22735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2576fa1/0xdab2421a42e49720 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.409169:0:24895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584230.409175:0:22735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2576fa1/0xdab2421a42e49720 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.409189:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2576fa1/0xdab2421a42e49720 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.409197:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2576fa1/0xdab2421a42e49720 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.409220:0:22735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584230.409224:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3bb4e74/0xdab2421a42e49727 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.409232:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1000 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584230.409236:0:22735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3bb4e74/0xdab2421a42e49727 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.409244:0:22735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3bb4e74/0xdab2421a42e49727 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.409255:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3bb4e74/0xdab2421a42e49727 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.409263:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3bb4e74/0xdab2421a42e49727 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.409275:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.409277:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.409278:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.409284:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784584230.410651:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584230.410662:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf6b015/0xdab2421a42e4972e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.410675:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=673s v=(0 0) 00010000:00010000:2.0:1784584230.410685:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584230.410691:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf6b015/0xdab2421a42e4972e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.410705:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaf6b015/0xdab2421a42e4972e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.410715:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf6b015/0xdab2421a42e4972e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.410723:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf6b015/0xdab2421a42e4972e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.410739:0:24895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784584230.410903:0:24253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784584230.410916:0:24253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af39117a/0xdab2421a42e49735 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.410925:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=673s v=(0 0) 00010000:00010000:1.0:1784584230.410928:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584230.410932:0:24253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af39117a/0xdab2421a42e49735 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.410943:0:24253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af39117a/0xdab2421a42e49735 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.410951:0:24253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af39117a/0xdab2421a42e49735 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.410958:0:24253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af39117a/0xdab2421a42e49735 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.410983:0:24253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784584230.410992:0:22736:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784584230.411000:0:22736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaf6b015/0xdab2421a42e4972e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.411012:0:22736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0a00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584230.411025:0:22736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf6b015/0xdab2421a42e4972e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.411036:0:22736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf6b015/0xdab2421a42e4972e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.411053:0:22736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaf6b015/0xdab2421a42e4972e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.411061:0:22736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaf6b015/0xdab2421a42e4972e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.411079:0:22736:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584230.411083:0:22736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af39117a/0xdab2421a42e49735 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.411091:0:22736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1d800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584230.411094:0:22736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af39117a/0xdab2421a42e49735 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.411102:0:22736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af39117a/0xdab2421a42e49735 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.411113:0:22736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af39117a/0xdab2421a42e49735 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.411121:0:22736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af39117a/0xdab2421a42e49735 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.411139:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.411141:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.411143:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.411149:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784584230.411412:0:24253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784584230.411419:0:24253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fbb221b/0xdab2421a42e4973c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.411427:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=673s v=(0 0) 00010000:00010000:1.0:1784584230.411430:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584230.411435:0:24253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fbb221b/0xdab2421a42e4973c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.411444:0:24253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fbb221b/0xdab2421a42e4973c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.411458:0:24253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fbb221b/0xdab2421a42e4973c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.411483:0:24253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fbb221b/0xdab2421a42e4973c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.411498:0:24253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584230.411578:0:25088:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584230.411584:0:25088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fbb221b/0xdab2421a42e4973c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.411593:0:25088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1c800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584230.411597:0:25088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fbb221b/0xdab2421a42e4973c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.411605:0:25088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fbb221b/0xdab2421a42e4973c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.411618:0:25088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fbb221b/0xdab2421a42e4973c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.411626:0:25088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fbb221b/0xdab2421a42e4973c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.411639:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.411641:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.411643:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784584230.412534:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584230.412544:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054f7bb81/0xdab2421a42e49743 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.412555:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=673s v=(0 0) 00010000:00010000:2.0:1784584230.412559:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584230.412564:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054f7bb81/0xdab2421a42e49743 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.412576:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054f7bb81/0xdab2421a42e49743 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.412596:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054f7bb81/0xdab2421a42e49743 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.412611:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054f7bb81/0xdab2421a42e49743 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.412632:0:24895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584230.412709:0:22736:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584230.412715:0:22736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054f7bb81/0xdab2421a42e49743 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.412896:0:22736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0600 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584230.412901:0:22736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054f7bb81/0xdab2421a42e49743 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.412912:0:22736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054f7bb81/0xdab2421a42e49743 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.412926:0:22736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054f7bb81/0xdab2421a42e49743 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.412934:0:22736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054f7bb81/0xdab2421a42e49743 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.412969:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.412972:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.412974:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784584230.413146:0:24253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784584230.413152:0:24253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfecb9db/0xdab2421a42e4974a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.413160:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=673s v=(0 0) 00010000:00010000:1.0:1784584230.413163:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584230.413167:0:24253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfecb9db/0xdab2421a42e4974a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.413178:0:24253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfecb9db/0xdab2421a42e4974a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.413186:0:24253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfecb9db/0xdab2421a42e4974a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.413192:0:24253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cfecb9db/0xdab2421a42e4974a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.413224:0:24253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584230.413377:0:22735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584230.413384:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cfecb9db/0xdab2421a42e4974a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.413393:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1c000 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584230.413396:0:22735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfecb9db/0xdab2421a42e4974a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.413404:0:22735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfecb9db/0xdab2421a42e4974a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784584230.413504:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584230.413510:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006747af3a/0xdab2421a42e49751 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.413519:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=673s v=(0 0) 00010000:00010000:2.0:1784584230.413522:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584230.413527:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006747af3a/0xdab2421a42e49751 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.413537:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006747af3a/0xdab2421a42e49751 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.413546:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006747af3a/0xdab2421a42e49751 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.413552:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006747af3a/0xdab2421a42e49751 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.413568:0:24895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584230.413576:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cfecb9db/0xdab2421a42e4974a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.413586:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfecb9db/0xdab2421a42e4974a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.413604:0:22735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584230.413609:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006747af3a/0xdab2421a42e49751 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.413617:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0e00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584230.413620:0:22735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006747af3a/0xdab2421a42e49751 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.413629:0:22735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006747af3a/0xdab2421a42e49751 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.413641:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006747af3a/0xdab2421a42e49751 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.413649:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006747af3a/0xdab2421a42e49751 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.413660:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.413662:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.413670:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584230.413891:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784584230.413942:0:24253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584230.413948:0:24253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e49758 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.413957:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1784584230.413961:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584230.413965:0:24253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e49758 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.413976:0:24253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e49758 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.413985:0:24253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e49758 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.413992:0:24253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e49758 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.414018:0:24253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784584230.414228:0:22736:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584230.414234:0:22736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e49758 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.414242:0:22736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:1.0:1784584230.414246:0:22736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e49758 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.414254:0:22736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e49758 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.414267:0:22736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e49758 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.414273:0:22736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e49758 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.414288:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584230.414289:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584230.414291:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784584230.414714:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584230.414720:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016276068/0xdab2421a42e4975f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.414735:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=673s v=(0 0) 00010000:00010000:2.0:1784584230.414738:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584230.414743:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016276068/0xdab2421a42e4975f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.414754:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016276068/0xdab2421a42e4975f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.414762:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016276068/0xdab2421a42e4975f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.414770:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016276068/0xdab2421a42e4975f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.414791:0:24895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784584230.414905:0:24253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584230.414912:0:24253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d423bce/0xdab2421a42e49766 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.414920:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1784584230.414923:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584230.414927:0:24253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d423bce/0xdab2421a42e49766 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.414949:0:24253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d423bce/0xdab2421a42e49766 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.414957:0:24253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d423bce/0xdab2421a42e49766 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.414963:0:24253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d423bce/0xdab2421a42e49766 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.414976:0:24253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784584230.414984:0:25088:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784584230.414988:0:25088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016276068/0xdab2421a42e4975f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.414996:0:25088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0c00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584230.414999:0:25088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016276068/0xdab2421a42e4975f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.415007:0:25088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016276068/0xdab2421a42e4975f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.415019:0:25088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016276068/0xdab2421a42e4975f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.415026:0:25088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016276068/0xdab2421a42e4975f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.415046:0:25088:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584230.415050:0:25088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d423bce/0xdab2421a42e49766 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.415056:0:25088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9e00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584230.415060:0:25088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d423bce/0xdab2421a42e49766 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.415067:0:25088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d423bce/0xdab2421a42e49766 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.415076:0:25088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d423bce/0xdab2421a42e49766 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.415083:0:25088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d423bce/0xdab2421a42e49766 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.415094:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.415096:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.415097:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584230.415192:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784584230.415364:0:24253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584230.415371:0:24253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009225274a/0xdab2421a42e4976d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.415379:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1784584230.415387:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584230.415392:0:24253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009225274a/0xdab2421a42e4976d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.415401:0:24253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009225274a/0xdab2421a42e4976d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.415409:0:24253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009225274a/0xdab2421a42e4976d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.415417:0:24253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009225274a/0xdab2421a42e4976d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.415431:0:24253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584230.415438:0:22736:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584230.415441:0:22736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009225274a/0xdab2421a42e4976d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.415448:0:22736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9400 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584230.415452:0:22736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009225274a/0xdab2421a42e4976d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.415460:0:22736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009225274a/0xdab2421a42e4976d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.415515:0:22736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009225274a/0xdab2421a42e4976d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.415533:0:22736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009225274a/0xdab2421a42e4976d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.415546:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.415548:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.415550:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784584230.415861:0:24253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584230.415867:0:24253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2576fa1/0xdab2421a42e49774 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.415875:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1784584230.415878:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584230.415883:0:24253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2576fa1/0xdab2421a42e49774 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.415892:0:24253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2576fa1/0xdab2421a42e49774 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.415899:0:24253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2576fa1/0xdab2421a42e49774 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.415905:0:24253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2576fa1/0xdab2421a42e49774 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.415918:0:24253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584230.415925:0:25088:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584230.415935:0:25088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2576fa1/0xdab2421a42e49774 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.415943:0:25088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584230.415946:0:25088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2576fa1/0xdab2421a42e49774 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.415954:0:25088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2576fa1/0xdab2421a42e49774 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.415964:0:25088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2576fa1/0xdab2421a42e49774 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.415971:0:25088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2576fa1/0xdab2421a42e49774 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.415983:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.415985:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.415986:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784584230.416423:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584230.416429:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014f055f7/0xdab2421a42e4977b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.416438:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=673s v=(0 0) 00010000:00010000:2.0:1784584230.416442:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584230.416446:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014f055f7/0xdab2421a42e4977b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.416456:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014f055f7/0xdab2421a42e4977b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.416492:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014f055f7/0xdab2421a42e4977b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.416499:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014f055f7/0xdab2421a42e4977b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.416510:0:24895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784584230.416737:0:22735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584230.416743:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014f055f7/0xdab2421a42e4977b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.416763:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0000 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:1.0:1784584230.416766:0:22735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014f055f7/0xdab2421a42e4977b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.416774:0:22735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014f055f7/0xdab2421a42e4977b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.416787:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014f055f7/0xdab2421a42e4977b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.416794:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014f055f7/0xdab2421a42e4977b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.416808:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584230.416810:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584230.416812:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784584230.416837:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584230.416843:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e49782 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.416851:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=673s v=(0 0) 00010000:00010000:2.0:1784584230.416854:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584230.416859:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e49782 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.416867:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e49782 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.416875:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e49782 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.416883:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e49782 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.416907:0:24895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784584230.417190:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584230.417196:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e49789 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.417205:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=673s v=(0 0) 00010000:00010000:2.0:1784584230.417208:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584230.417213:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e49789 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.417222:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e49789 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.417230:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e49789 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.417238:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e49789 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.417251:0:24895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1784584230.419581:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584230.419595:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebb581d5/0xdab2421a42e49790 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.419610:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=673s v=(0 0) 00010000:00010000:2.0:1784584230.419622:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584230.419628:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebb581d5/0xdab2421a42e49790 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.419642:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebb581d5/0xdab2421a42e49790 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.419651:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebb581d5/0xdab2421a42e49790 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.419657:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebb581d5/0xdab2421a42e49790 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.419677:0:24895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1784584230.419811:0:22735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784584230.419818:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e49782 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.419826:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1600 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:1.0:1784584230.419830:0:22735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e49782 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.419840:0:22735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e49782 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.419875:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e49782 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.419883:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cfd0bd4/0xdab2421a42e49782 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.419901:0:22735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784584230.419905:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e49789 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.419912:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:1.0:1784584230.419916:0:22735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e49789 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.419933:0:22735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e49789 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.419943:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e49789 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1784584230.419945:0:24895:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00010000:00010000:1.0:1784584230.419950:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b0cd02a/0xdab2421a42e49789 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.419961:0:22735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584230.419964:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebb581d5/0xdab2421a42e49790 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.419975:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0400 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:1.0:1784584230.419977:0:22735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebb581d5/0xdab2421a42e49790 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.419983:0:22735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebb581d5/0xdab2421a42e49790 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.419992:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebb581d5/0xdab2421a42e49790 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.419998:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebb581d5/0xdab2421a42e49790 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.420008:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584230.420010:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584230.420012:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584230.420031:0:24895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302425c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22772:x1871271599260928:12345-0@lo:5:osp-pre-0-0.0 Request processed in 91189us (91352us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584230.420041:0:24895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784584230.420096:0:22772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302424700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22772:1871271599260928:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1784584230.420111:0:22772:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:2.0:1784584230.420154:0:22772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b45500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22772:1871271599261824:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1784584230.420187:0:22772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584230.420208:0:22772:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cac2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784584230.420224:0:24895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599261824 00000100:00100000:2.0:1784584230.420229:0:24895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599261824 00000100:00100000:2.0:1784584230.420272:0:24895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784584230.420286:0:24895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22772:x1871271599261824:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1784584230.420322:0:24895:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:1.0:1784584230.421509:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584230.421516:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784584230.422160:0:24253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584230.422879:0:24253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c49d766/0xdab2421a42e49797 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.422895:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1784584230.422900:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584230.422906:0:24253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c49d766/0xdab2421a42e49797 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.422933:0:24253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c49d766/0xdab2421a42e49797 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.422943:0:24253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c49d766/0xdab2421a42e49797 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.422951:0:24253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c49d766/0xdab2421a42e49797 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.422972:0:24253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784584230.423019:0:22735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584230.423025:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c49d766/0xdab2421a42e49797 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.423034:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8000 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:1.0:1784584230.423038:0:22735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c49d766/0xdab2421a42e49797 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.423056:0:22735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c49d766/0xdab2421a42e49797 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.423071:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c49d766/0xdab2421a42e49797 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.423078:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c49d766/0xdab2421a42e49797 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584230.423094:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584230.423096:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584230.423098:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784584230.423543:0:24253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584230.423550:0:24253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eea874b8/0xdab2421a42e4979e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.423559:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1784584230.423562:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584230.423566:0:24253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eea874b8/0xdab2421a42e4979e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.423576:0:24253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eea874b8/0xdab2421a42e4979e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.423642:0:24253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eea874b8/0xdab2421a42e4979e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.423662:0:24253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eea874b8/0xdab2421a42e4979e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.423678:0:24253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584230.423686:0:25088:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584230.423691:0:25088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eea874b8/0xdab2421a42e4979e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.423699:0:25088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9000 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584230.423702:0:25088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eea874b8/0xdab2421a42e4979e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.423713:0:25088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eea874b8/0xdab2421a42e4979e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.423726:0:25088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eea874b8/0xdab2421a42e4979e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.423734:0:25088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eea874b8/0xdab2421a42e4979e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.423747:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.423749:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.423751:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784584230.426835:0:24250:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:2.0:1784584230.427183:0:24250:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1784584230.427654:0:24895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22772:x1871271599261824:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7140us (7237us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1784584230.427816:0:24895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784584230.427865:0:22772:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1784584230.428224:0:22772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b45500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22772:1871271599261824:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1784584230.428240:0:22772:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00002000:00010000:2.0:1784584230.428958:0:24253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784584230.428968:0:24253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dc45d82/0xdab2421a42e497a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.428986:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=673s v=(0 0) 00010000:00010000:2.0:1784584230.428991:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584230.428998:0:24253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dc45d82/0xdab2421a42e497a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.429012:0:24253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004dc45d82/0xdab2421a42e497a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.429024:0:24253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dc45d82/0xdab2421a42e497a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.429203:0:24253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004dc45d82/0xdab2421a42e497a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.429230:0:24253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584230.429241:0:22736:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584230.429247:0:22736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004dc45d82/0xdab2421a42e497a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.429255:0:22736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1400 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:2.0:1784584230.429259:0:22736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004dc45d82/0xdab2421a42e497a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.429269:0:22736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004dc45d82/0xdab2421a42e497a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.429287:0:22736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004dc45d82/0xdab2421a42e497a5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.429295:0:22736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dc45d82/0xdab2421a42e497a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.429312:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584230.429314:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584230.429315:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784584230.430430:0:24253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584230.430450:0:24253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d423bce/0xdab2421a42e497ac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.430881:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1784584230.430886:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584230.430893:0:24253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d423bce/0xdab2421a42e497ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.430908:0:24253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d423bce/0xdab2421a42e497ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.430917:0:24253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d423bce/0xdab2421a42e497ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.430926:0:24253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d423bce/0xdab2421a42e497ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.430944:0:24253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584230.430955:0:22735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584230.430960:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d423bce/0xdab2421a42e497ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.430968:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9e00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584230.430973:0:22735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d423bce/0xdab2421a42e497ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.430981:0:22735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d423bce/0xdab2421a42e497ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.431285:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d423bce/0xdab2421a42e497ac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.431294:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d423bce/0xdab2421a42e497ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.431313:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.431315:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.431317:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784584230.433837:0:24253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584230.433849:0:24253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2576fa1/0xdab2421a42e497b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.433865:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1784584230.433870:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584230.433876:0:24253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2576fa1/0xdab2421a42e497b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.433889:0:24253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2576fa1/0xdab2421a42e497b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.433898:0:24253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2576fa1/0xdab2421a42e497b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.433907:0:24253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2576fa1/0xdab2421a42e497b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.433936:0:24253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584230.433947:0:25088:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584230.433953:0:25088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2576fa1/0xdab2421a42e497b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.433960:0:25088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584230.433965:0:25088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2576fa1/0xdab2421a42e497b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.433975:0:25088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2576fa1/0xdab2421a42e497b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.433990:0:25088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2576fa1/0xdab2421a42e497b3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.433998:0:25088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2576fa1/0xdab2421a42e497b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.434667:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.434670:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584230.434673:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784584230.436094:0:25070:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:0.0:1784584230.436129:0:25070:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1784584230.436134:0:25070:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:3.0:1784584230.436220:0:24253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584230.436297:0:24253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009225274a/0xdab2421a42e497ba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.436313:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1784584230.436327:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1784584230.436438:0:24255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c234700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23492:x1871271599261696:12345-0@lo:5:osp-pre-1-1.0 Request processed in 50902us (53662us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1784584230.436450:0:24255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784584230.436520:0:23492:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00010000:00010000:3.0:1784584230.436522:0:24253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009225274a/0xdab2421a42e497ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584230.436528:0:23492:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c236680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23492:1871271599261696:0@lo:5:osp-pre-1-1.0 00010000:00010000:3.0:1784584230.436537:0:24253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009225274a/0xdab2421a42e497ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784584230.436542:0:23492:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00010000:00010000:3.0:1784584230.436546:0:24253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009225274a/0xdab2421a42e497ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.436553:0:24253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009225274a/0xdab2421a42e497ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.436571:0:24253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784584230.436588:0:23492:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c236680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23492:1871271599261952:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1784584230.436623:0:23492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584230.436647:0:23492:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cba1000 going to sleep for 11 seconds 00000100:00100000:0.0:1784584230.436666:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599261952 00000100:00100000:0.0:1784584230.436671:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599261952 00000100:00100000:0.0:1784584230.436710:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784584230.436718:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23492:x1871271599261952:12345-0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1784584230.436739:0:22736:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584230.436750:0:22736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009225274a/0xdab2421a42e497ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.436759:0:22736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9400 already unused, calling callback (ffffffffc0e1e230) 00000100:00100000:0.0:1784584230.436761:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23492:x1871271599261952:12345-0@lo:900:osp-pre-1-1.0 Request processed in 44us (137us total) trans 0 rc 0/0 00010000:00010000:2.0:1784584230.436764:0:22736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009225274a/0xdab2421a42e497ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584230.436767:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1784584230.436774:0:22736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009225274a/0xdab2421a42e497ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.436790:0:22736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009225274a/0xdab2421a42e497ba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1784584230.436793:0:23492:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b43c236680 x1871271599261952/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784584246 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1784584230.436799:0:22736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009225274a/0xdab2421a42e497ba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584230.436815:0:23492:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c236680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23492:1871271599261952:0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1784584230.436816:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584230.436817:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584230.436819:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784584230.437130:0:24253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584230.437137:0:24253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006030906e/0xdab2421a42e497c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.437147:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1784584230.437150:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584230.437155:0:24253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006030906e/0xdab2421a42e497c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.437164:0:24253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006030906e/0xdab2421a42e497c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.437172:0:24253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006030906e/0xdab2421a42e497c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.437185:0:24253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006030906e/0xdab2421a42e497c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.437205:0:24253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784584230.437383:0:22735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784584230.437388:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006030906e/0xdab2421a42e497c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.437396:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8e00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:0.0:1784584230.437399:0:22735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006030906e/0xdab2421a42e497c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.437406:0:22735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006030906e/0xdab2421a42e497c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.437416:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006030906e/0xdab2421a42e497c1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.437422:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006030906e/0xdab2421a42e497c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.437435:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584230.437436:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584230.437438:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784584230.438055:0:24253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584230.438063:0:24253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f3d427d/0xdab2421a42e497c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.438072:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1784584230.438076:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584230.438081:0:24253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f3d427d/0xdab2421a42e497c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.438091:0:24253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f3d427d/0xdab2421a42e497c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.438099:0:24253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f3d427d/0xdab2421a42e497c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.438107:0:24253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f3d427d/0xdab2421a42e497c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.438207:0:24253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784584230.438336:0:25088:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784584230.438342:0:25088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f3d427d/0xdab2421a42e497c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.438359:0:25088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8c00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:0.0:1784584230.438369:0:25088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f3d427d/0xdab2421a42e497c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.438378:0:25088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f3d427d/0xdab2421a42e497c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.438389:0:25088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f3d427d/0xdab2421a42e497c8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.438396:0:25088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f3d427d/0xdab2421a42e497c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.438410:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584230.438412:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584230.438414:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784584230.438814:0:24253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584230.438821:0:24253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053259fc7/0xdab2421a42e497cf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.438836:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1784584230.438840:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584230.438845:0:24253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053259fc7/0xdab2421a42e497cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.438855:0:24253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053259fc7/0xdab2421a42e497cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.438863:0:24253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053259fc7/0xdab2421a42e497cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.438870:0:24253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053259fc7/0xdab2421a42e497cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.438891:0:24253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584230.439026:0:22736:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584230.439033:0:22736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053259fc7/0xdab2421a42e497cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.439041:0:22736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9c00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:2.0:1784584230.439045:0:22736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053259fc7/0xdab2421a42e497cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.439065:0:22736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053259fc7/0xdab2421a42e497cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.439076:0:22736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053259fc7/0xdab2421a42e497cf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.439084:0:22736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053259fc7/0xdab2421a42e497cf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.439097:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584230.439099:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584230.439101:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784584230.439389:0:24253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584230.439395:0:24253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3c64fd4/0xdab2421a42e497d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.439403:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1784584230.439407:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584230.439411:0:24253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3c64fd4/0xdab2421a42e497d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.439421:0:24253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3c64fd4/0xdab2421a42e497d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.439440:0:24253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3c64fd4/0xdab2421a42e497d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.439447:0:24253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3c64fd4/0xdab2421a42e497d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.439463:0:24253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784584230.439485:0:22735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784584230.439490:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3c64fd4/0xdab2421a42e497d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.439498:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9a00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:0.0:1784584230.439501:0:22735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3c64fd4/0xdab2421a42e497d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.439508:0:22735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3c64fd4/0xdab2421a42e497d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.439520:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3c64fd4/0xdab2421a42e497d6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.439533:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3c64fd4/0xdab2421a42e497d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584230.439545:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584230.439547:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584230.439549:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784584230.439792:0:24253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784584230.439798:0:24253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d423bce/0xdab2421a42e497dd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.439806:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=673s v=(0 0) 00010000:00010000:3.0:1784584230.439809:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584230.439814:0:24253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d423bce/0xdab2421a42e497dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.439823:0:24253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d423bce/0xdab2421a42e497dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.439832:0:24253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d423bce/0xdab2421a42e497dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.439839:0:24253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d423bce/0xdab2421a42e497dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584230.439868:0:24253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1784584230.439898:0:24253:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:3.0:1784584230.439983:0:24253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22774:x1871271599261440:12345-0@lo:5:osp-pre-1-0.0 Request processed in 96132us (100985us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584230.439992:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784584230.440110:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bc0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22774:1871271599261440:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1784584230.440127:0:22774:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:3.0:1784584230.440168:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bc0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22774:1871271599262080:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1784584230.440201:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584230.440227:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b417259e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784584230.440244:0:24253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599262080 00000100:00100000:3.0:1784584230.440249:0:24253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599262080 00000100:00100000:3.0:1784584230.440281:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784584230.440288:0:24253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22774:x1871271599262080:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1784584230.440320:0:24253:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00010000:00010000:2.0:1784584230.440659:0:25088:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584230.440666:0:25088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d423bce/0xdab2421a42e497dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.440675:0:25088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9e00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:2.0:1784584230.440680:0:25088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d423bce/0xdab2421a42e497dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.440688:0:25088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d423bce/0xdab2421a42e497dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.440756:0:25088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d423bce/0xdab2421a42e497dd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.440775:0:25088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d423bce/0xdab2421a42e497dd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584230.440792:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584230.440794:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584230.440795:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584230.444638:0:24253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22774:x1871271599262080:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4341us (4427us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1784584230.444653:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784584230.445778:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bc0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22774:1871271599262080:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1784584230.445798:0:22774:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000001:02000400:0.0:1784584230.769242:0:25428:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1784584230.893572:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784584231.540822:0:25480:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784584231.541006:0:25480:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784584231.923355:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784584232.359607:0:25530:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784584232.360125:0:25530:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1784584232.617038:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584232.617389:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580286080 00000100:00100000:1.0:1784584232.617399:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580286080 00000100:00100000:1.0:1784584232.617445:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 114 00000100:00100000:1.0:1784584232.617452:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2397:x1871271580286080:12345-192.168.203.51@tcp:250:mount.lustre.0 00010000:00080000:1.0:1784584232.617519:0:22741:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 42c9664f-6d9c-42f4-930b-fd8093c44492@192.168.203.51@tcp t0 exp 0000000000000000 cur 675 last 0 00000020:00000080:1.0:1784584232.617545:0:22741:0:(genops.c:1406:class_connect()) connect: client 42c9664f-6d9c-42f4-930b-fd8093c44492, cookie 0xdab2421a42e497e4 00000100:00080000:1.0:1784584232.617685:0:22741:0:(import.c:65:import_set_state_nolock()) ffff98b303a69000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784584232.617756:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42c9664f-6d9c-42f4-930b-fd8093c44492+5:2397:x1871271580286080:12345-192.168.203.51@tcp:250:mount.lustre.0 Request processed in 302us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584232.617764:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 114 00000100:00100000:3.0:1784584232.621925:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784584232.621957:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599262208:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784584232.622022:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584232.622165:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599262208 00000100:00100000:2.0:1784584232.622173:0:24258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599262208 00000100:00100000:2.0:1784584232.622239:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784584232.622249:0:24258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599262208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784584232.622277:0:24258:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784584232.622341:0:24258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599262208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584232.622349:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1784584232.622405:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784584232.623230:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584232.623299:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580286208 00000100:00100000:3.0:1784584232.623319:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580286208 00000100:00100000:3.0:1784584232.623395:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 115 00000100:00100000:1.0:1784584232.623403:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599262208:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784584232.623406:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c231850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42c9664f-6d9c-42f4-930b-fd8093c44492+5:18079:x1871271580286208:12345-192.168.203.51@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784584232.623421:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584232.623440:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ebd9000/0xdab2421a42e497eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee81a expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584232.623499:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ebd9000/0xdab2421a42e497eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee81a expref: 6 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584232.623511:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ebd9000/0xdab2421a42e497eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee81a expref: 6 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584232.623521:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd9000, rc 0) 00000100:00100000:3.0:1784584232.623561:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c231850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42c9664f-6d9c-42f4-930b-fd8093c44492+6:18079:x1871271580286208:12345-192.168.203.51@tcp:101:mount.lustre.0 Request processed in 158us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584232.623568:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 115 00000100:00100000:3.0:1784584232.630205:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584232.630390:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580286336 00000100:00100000:2.0:1784584232.630401:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580286336 00000100:00100000:2.0:1784584232.630463:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 116 00000100:00100000:2.0:1784584232.630507:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42c9664f-6d9c-42f4-930b-fd8093c44492+6:18079:x1871271580286336:12345-192.168.203.51@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784584232.630618:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42c9664f-6d9c-42f4-930b-fd8093c44492+6:18079:x1871271580286336:12345-192.168.203.51@tcp:501:mount.lustre.0 Request processed in 114us (422us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784584232.630652:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 116 00000100:00100000:2.0:1784584232.639181:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584232.639398:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580286464 00000100:00100000:1.0:1784584232.639408:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580286464 00000100:00100000:1.0:1784584232.639504:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 117 00000100:00100000:1.0:1784584232.639515:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42c9664f-6d9c-42f4-930b-fd8093c44492+6:18079:x1871271580286464:12345-192.168.203.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784584232.639532:0:22741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584232.639550:0:22741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b303b1d800/0xdab2421a42e497f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee821 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584232.639580:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b303b1d800/0xdab2421a42e497f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee821 expref: 7 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584232.639592:0:22741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b303b1d800/0xdab2421a42e497f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee821 expref: 7 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584232.639603:0:22741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1d800, rc 0) 00000100:00100000:1.0:1784584232.639663:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42c9664f-6d9c-42f4-930b-fd8093c44492+7:18079:x1871271580286464:12345-192.168.203.51@tcp:101:mount.lustre.0 Request processed in 150us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584232.639670:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 117 00000100:00100000:0.0:1784584232.643852:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584232.643953:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580286592 00000100:00100000:3.0:1784584232.643964:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580286592 00000100:00100000:3.0:1784584232.644025:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 118 00000100:00100000:3.0:1784584232.644035:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c233c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42c9664f-6d9c-42f4-930b-fd8093c44492+7:18079:x1871271580286592:12345-192.168.203.51@tcp:501:mount.lustre.0 00000100:00100000:3.0:1784584232.645176:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c233c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42c9664f-6d9c-42f4-930b-fd8093c44492+8:18079:x1871271580286592:12345-192.168.203.51@tcp:501:mount.lustre.0 Request processed in 1136us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584232.645189:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 118 00000100:00100000:3.0:1784584232.649927:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584232.649995:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580286720 00000100:00100000:2.0:1784584232.650012:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580286720 00000100:00100000:2.0:1784584232.650069:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 119 00000100:00100000:2.0:1784584232.650080:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42c9664f-6d9c-42f4-930b-fd8093c44492+8:18079:x1871271580286720:12345-192.168.203.51@tcp:503:mount.lustre.0 00000100:00100000:2.0:1784584232.650228:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42c9664f-6d9c-42f4-930b-fd8093c44492+8:18079:x1871271580286720:12345-192.168.203.51@tcp:503:mount.lustre.0 Request processed in 149us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584232.650236:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 119 00000100:00100000:2.0:1784584232.653114:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584232.653691:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580286848 00000100:00100000:3.0:1784584232.653713:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580286848 00000100:00100000:3.0:1784584232.653773:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 120 00000100:00100000:3.0:1784584232.653784:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43fe8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42c9664f-6d9c-42f4-930b-fd8093c44492+8:18097:x1871271580286848:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784584232.653937:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43fe8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42c9664f-6d9c-42f4-930b-fd8093c44492+8:18097:x1871271580286848:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 154us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584232.653945:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 120 00000100:00100000:0.0:1784584232.669657:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584232.669788:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580286976 00000100:00100000:1.0:1784584232.669798:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580286976 00000100:00100000:1.0:1784584232.669851:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 121 00000100:00100000:1.0:1784584232.669868:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43fe8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42c9664f-6d9c-42f4-930b-fd8093c44492+8:18097:x1871271580286976:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784584232.670019:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43fe8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42c9664f-6d9c-42f4-930b-fd8093c44492+8:18097:x1871271580286976:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 158us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584232.670028:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 121 00000100:00100000:0.0:1784584232.690987:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584232.691299:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580287104 00000100:00100000:2.0:1784584232.691309:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580287104 00000100:00100000:2.0:1784584232.691430:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 122 00000100:00100000:2.0:1784584232.691441:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43fe8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42c9664f-6d9c-42f4-930b-fd8093c44492+8:18097:x1871271580287104:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784584232.691623:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43fe8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42c9664f-6d9c-42f4-930b-fd8093c44492+8:18097:x1871271580287104:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 183us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584232.691632:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 122 00000100:00100000:2.0:1784584232.703278:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584232.703396:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580287232 00000100:00100000:3.0:1784584232.703407:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580287232 00000100:00100000:3.0:1784584232.703504:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 123 00000100:00100000:3.0:1784584232.703514:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43fe8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42c9664f-6d9c-42f4-930b-fd8093c44492+8:18079:x1871271580287232:12345-192.168.203.51@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784584232.703530:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584232.703548:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b43ebd9800/0xdab2421a42e497f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee852 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584232.703577:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ebd9800/0xdab2421a42e497f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee852 expref: 9 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584232.703589:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b43ebd9800/0xdab2421a42e497f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee852 expref: 9 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584232.703598:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd9800, rc 0) 00000100:00100000:3.0:1784584232.703642:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43fe8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42c9664f-6d9c-42f4-930b-fd8093c44492+9:18079:x1871271580287232:12345-192.168.203.51@tcp:101:mount.lustre.0 Request processed in 130us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584232.703648:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 123 00000100:00100000:0.0:1784584232.711038:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584232.711130:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580287360 00000100:00100000:2.0:1784584232.711139:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580287360 00000100:00100000:2.0:1784584232.711197:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 124 00000100:00100000:2.0:1784584232.711205:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43fe8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42c9664f-6d9c-42f4-930b-fd8093c44492+9:18079:x1871271580287360:12345-192.168.203.51@tcp:256:mount.lustre.0 20000000:01000000:2.0:1784584232.711231:0:22742:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1784584232.711255:0:22742:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784584232.711259:0:22742:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784584232.711269:0:22742:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784584232.711271:0:22742:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1784584232.711274:0:22742:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1784584232.721254:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43fe8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42c9664f-6d9c-42f4-930b-fd8093c44492+9:18079:x1871271580287360:12345-192.168.203.51@tcp:256:mount.lustre.0 Request processed in 10039us (10215us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584232.721268:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 124 00000100:00100000:0.0:1784584232.724773:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584232.726522:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580287488 00000100:00100000:1.0:1784584232.726536:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580287488 00000100:00100000:1.0:1784584232.726664:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 125 00000100:00100000:1.0:1784584232.726674:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43fe8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42c9664f-6d9c-42f4-930b-fd8093c44492+9:18079:x1871271580287488:12345-192.168.203.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784584232.726697:0:22741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584232.726715:0:22741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b303b1c400/0xdab2421a42e49800 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee859 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584232.727787:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b303b1c400/0xdab2421a42e49800 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee859 expref: 10 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584232.727804:0:22741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b303b1c400/0xdab2421a42e49800 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee859 expref: 10 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584232.727814:0:22741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1c400, rc 0) 00000100:00100000:1.0:1784584232.728012:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43fe8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42c9664f-6d9c-42f4-930b-fd8093c44492+10:18079:x1871271580287488:12345-192.168.203.51@tcp:101:mount.lustre.0 Request processed in 1338us (3248us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584232.728020:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 125 00000100:00100000:0.0:1784584232.733889:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584232.733954:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580287616 00000100:00100000:2.0:1784584232.733964:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580287616 00000100:00100000:2.0:1784584232.734020:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 126 00000100:00100000:2.0:1784584232.734032:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43fe8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42c9664f-6d9c-42f4-930b-fd8093c44492+10:18079:x1871271580287616:12345-192.168.203.51@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784584232.734191:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43fe8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42c9664f-6d9c-42f4-930b-fd8093c44492+10:18079:x1871271580287616:12345-192.168.203.51@tcp:501:mount.lustre.0 Request processed in 162us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584232.734199:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 126 00000100:00100000:0.0:1784584232.736044:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584232.736131:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580287744 00000100:00100000:1.0:1784584232.736140:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580287744 00000100:00100000:1.0:1784584232.736188:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 127 00000100:00100000:1.0:1784584232.736197:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43fe8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42c9664f-6d9c-42f4-930b-fd8093c44492+10:18079:x1871271580287744:12345-192.168.203.51@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784584232.736652:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43fe8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42c9664f-6d9c-42f4-930b-fd8093c44492+10:18079:x1871271580287744:12345-192.168.203.51@tcp:503:mount.lustre.0 Request processed in 455us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584232.736661:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 127 00000100:00100000:0.0:1784584232.739963:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584232.740678:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580287872 00000100:00100000:2.0:1784584232.740737:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580287872 00000100:00100000:2.0:1784584232.740900:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 128 00000100:00100000:2.0:1784584232.740912:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42c9664f-6d9c-42f4-930b-fd8093c44492+10:18104:x1871271580287872:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784584232.741069:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42c9664f-6d9c-42f4-930b-fd8093c44492+10:18104:x1871271580287872:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 159us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584232.741077:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 128 00000100:00100000:0.0:1784584232.752242:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584232.752331:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580288000 00000100:00100000:1.0:1784584232.752349:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580288000 00000100:00100000:1.0:1784584232.752400:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 129 00000100:00100000:1.0:1784584232.752409:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42c9664f-6d9c-42f4-930b-fd8093c44492+10:18104:x1871271580288000:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784584232.752579:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42c9664f-6d9c-42f4-930b-fd8093c44492+10:18104:x1871271580288000:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 171us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584232.752587:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 129 00000100:00100000:0.0:1784584232.763914:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584232.763958:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584232.764256:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580288128 00000100:00100000:3.0:1784584232.764267:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580288128 00000100:00100000:3.0:1784584232.764313:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580288384 00000100:00100000:3.0:1784584232.764317:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580288384 00000100:00100000:3.0:1784584232.764367:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:3.0:1784584232.764374:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1871271580288128:12345-192.168.203.51@tcp:38:mount.lustre.0 00010000:00080000:3.0:1784584232.764405:0:22748:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 341d21c5-fdb2-43c1-8bba-09bf4a7f7165@192.168.203.51@tcp t0 exp 0000000000000000 cur 675 last 0 00000020:00000080:3.0:1784584232.764497:0:22748:0:(genops.c:1406:class_connect()) connect: client 341d21c5-fdb2-43c1-8bba-09bf4a7f7165, cookie 0xdab2421a42e49807 00000004:00100000:3.0:1784584232.764521:0:22748:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1784584232.764953:0:22748:0:(import.c:65:import_set_state_nolock()) ffff98b4203b6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784584232.765028:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+6:2397:x1871271580288128:12345-192.168.203.51@tcp:38:mount.lustre.0 Request processed in 653us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584232.765037:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:3.0:1784584232.765054:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:3.0:1784584232.765060:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1871271580288384:12345-192.168.203.51@tcp:38:mount.lustre.0 00010000:00080000:3.0:1784584232.765074:0:22748:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 341d21c5-fdb2-43c1-8bba-09bf4a7f7165@192.168.203.51@tcp t0 exp 0000000000000000 cur 675 last 0 00000020:00000080:3.0:1784584232.765104:0:22748:0:(genops.c:1406:class_connect()) connect: client 341d21c5-fdb2-43c1-8bba-09bf4a7f7165, cookie 0xdab2421a42e4980e 00000004:00100000:3.0:1784584232.765118:0:22748:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1784584232.765250:0:22748:0:(import.c:65:import_set_state_nolock()) ffff98b41e839000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784584232.765276:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+6:2397:x1871271580288384:12345-192.168.203.51@tcp:38:mount.lustre.0 Request processed in 214us (1318us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584232.765282:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:0.0:1784584232.773788:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584232.773855:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584232.775361:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584232.779993:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580288640 00000100:00100000:3.0:1784584232.780007:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580288640 00000100:00100000:2.0:1784584232.780167:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580288512 00000100:00100000:2.0:1784584232.780172:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580288512 00000100:00100000:2.0:1784584232.780191:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580288256 00000100:00100000:2.0:1784584232.780195:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580288256 00000100:00080000:3.0:1784584232.780252:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784584232.780256:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584232.780286:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:2.0:1784584232.780299:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+7:18079:x1871271580288640:12345-192.168.203.51@tcp:41:mount.lustre.0 00000004:00000024:2.0:1784584232.780346:0:22748:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1784584232.780364:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 10 00000100:00100000:0.0:1784584232.780378:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+6:0:x1871271580288512:12345-192.168.203.51@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784584232.780402:0:23817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784584232.780797:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+6:0:x1871271580288512:12345-192.168.203.51@tcp:41:mount.lustre.0 Request processed in 421us (6939us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584232.780805:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 10 00000100:00100000:0.0:1784584232.780828:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 11 00000100:00100000:0.0:1784584232.780836:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+7:0:x1871271580288256:12345-192.168.203.51@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784584232.780846:0:23817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1784584232.780873:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+7:0:x1871271580288256:12345-192.168.203.51@tcp:41:mount.lustre.0 Request processed in 38us (5517us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584232.780880:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 11 00000100:00100000:2.0:1784584232.782673:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+7:18079:x1871271580288640:12345-192.168.203.51@tcp:41:mount.lustre.0 Request processed in 169us (6685us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584232.782742:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:0.0:1784584232.784146:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584232.784226:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580288768 00000100:00100000:1.0:1784584232.784234:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580288768 00000100:00100000:1.0:1784584232.784318:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 12 00000100:00100000:1.0:1784584232.784329:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+6:18079:x1871271580288768:12345-192.168.203.51@tcp:40:mount.lustre.0 00000100:00100000:1.0:1784584232.784425:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+6:18079:x1871271580288768:12345-192.168.203.51@tcp:40:mount.lustre.0 Request processed in 98us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584232.784433:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 12 00000100:00100000:1.0:1784584232.789063:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584232.789147:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584232.789709:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584232.789783:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580289152 00000100:00100000:0.0:1784584232.789793:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580289152 00000100:00100000:0.0:1784584232.789858:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 3 00000100:00100000:0.0:1784584232.789868:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+6:18079:x1871271580289152:12345-192.168.203.51@tcp:900:mount.lustre.0 00000100:00100000:0.0:1784584232.789971:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+6:18079:x1871271580289152:12345-192.168.203.51@tcp:900:mount.lustre.0 Request processed in 104us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584232.789979:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 3 00000100:00100000:2.0:1784584232.790604:0:24895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580288896 00000100:00100000:2.0:1784584232.790611:0:24895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580288896 00000100:00100000:2.0:1784584232.790643:0:24895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580289024 00000100:00100000:2.0:1784584232.790646:0:24895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580289024 00000100:00100000:2.0:1784584232.790671:0:24895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:2.0:1784584232.790677:0:24895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2397:x1871271580288896:12345-192.168.203.51@tcp:8:mount.lustre.0 00010000:00080000:2.0:1784584232.790714:0:24895:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 341d21c5-fdb2-43c1-8bba-09bf4a7f7165@192.168.203.51@tcp t0 exp 0000000000000000 cur 675 last 0 00000020:00000080:2.0:1784584232.790741:0:24895:0:(genops.c:1406:class_connect()) connect: client 341d21c5-fdb2-43c1-8bba-09bf4a7f7165, cookie 0xdab2421a42e49815 00002000:00100000:2.0:1784584232.790753:0:24895:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 341d21c5-fdb2-43c1-8bba-09bf4a7f7165/ffff98b302474800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784584232.790764:0:24895:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1784584232.791093:0:25386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:1.0:1784584232.791099:0:25386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437692680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2397:x1871271580289024:12345-192.168.203.51@tcp:8:mount.lustre.0 00010000:00080000:1.0:1784584232.791119:0:25386:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 341d21c5-fdb2-43c1-8bba-09bf4a7f7165@192.168.203.51@tcp t0 exp 0000000000000000 cur 675 last 0 00000020:00000080:1.0:1784584232.791137:0:25386:0:(genops.c:1406:class_connect()) connect: client 341d21c5-fdb2-43c1-8bba-09bf4a7f7165, cookie 0xdab2421a42e4981c 00002000:00100000:1.0:1784584232.791142:0:25386:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 341d21c5-fdb2-43c1-8bba-09bf4a7f7165/ffff98b303a6f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784584232.791155:0:25386:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784584232.791255:0:25386:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784584232.791284:0:25386:0:(import.c:65:import_set_state_nolock()) ffff98b303a68000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784584232.791349:0:25386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437692680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+6:2397:x1871271580289024:12345-192.168.203.51@tcp:8:mount.lustre.0 Request processed in 248us (2201us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584232.791364:0:25386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 17 00002000:00080000:2.0:1784584232.791510:0:24895:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784584232.791525:0:24895:0:(import.c:65:import_set_state_nolock()) ffff98b302477800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784584232.791548:0:24895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+6:2397:x1871271580288896:12345-192.168.203.51@tcp:8:mount.lustre.0 Request processed in 870us (2493us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584232.791554:0:24895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:1.0:1784584232.793150:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584232.793338:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580289280 00000100:00100000:3.0:1784584232.793347:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580289280 00000100:00100000:3.0:1784584232.793399:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:3.0:1784584232.793408:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+6:18079:x1871271580289280:12345-192.168.203.51@tcp:33:mount.lustre.0 00000004:00080000:3.0:1784584232.795441:0:22750:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1915us 00000004:00200000:3.0:1784584232.819801:0:22750:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1784584232.821206:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+6:18079:x1871271580289280:12345-192.168.203.51@tcp:33:mount.lustre.0 Request processed in 27790us (28053us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584232.821218:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 0 00010000:00010000:2.0:1784584232.941688:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584232.965422:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584232.965553:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580289408 00000100:00100000:3.0:1784584232.965563:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580289408 00000100:00100000:3.0:1784584232.965624:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 13 00000100:00100000:3.0:1784584232.965635:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+6:18127:x1871271580289408:12345-192.168.203.51@tcp:101:mkdir.0 00010000:00010000:3.0:1784584232.965655:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584232.965695:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e49823 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee88a expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584232.965768:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e4982a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584232.965782:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e4982a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584232.965797:0:22747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e4982a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584232.966050:0:22747:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784584232.966054:0:22747:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784584232.966089:0:22747:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e4982a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584232.966116:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e49823 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee88a expref: 8 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584232.966153:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e4982a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee88a expref: 7 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584232.966161:0:22747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b43e8ab600) 00010000:00010000:3.0:1784584232.966164:0:22747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784584232.966167:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd9c00, rc 0) 00000100:00100000:3.0:1784584232.966232:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+7:18127:x1871271580289408:12345-192.168.203.51@tcp:101:mkdir.0 Request processed in 599us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584232.966239:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 13 00000100:00100000:1.0:1784584233.645827:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784584233.645855:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599262336:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784584233.645929:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584233.645984:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b302b44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599262464:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784584233.646009:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584233.646212:0:23818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599262336 00000100:00100000:2.0:1784584233.646220:0:23818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599262336 00000100:00100000:2.0:1784584233.646274:0:23818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599262464 00000100:00100000:2.0:1784584233.646277:0:23818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599262464 00000100:00100000:2.0:1784584233.646295:0:23818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784584233.646305:0:23818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b437693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599262336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784584233.646349:0:23818:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784584233.646372:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784584233.646383:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599262464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784584233.646403:0:22753:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1784584233.646419:0:23818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b437693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599262336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584233.646428:0:23818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784584233.646448:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599262464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584233.646455:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784584233.646533:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b302b44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599262464:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784584233.646545:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599262336:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784584233.965686:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584234.763871:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584234.764016:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580289536 00000100:00100000:2.0:1784584234.764029:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580289536 00000100:00100000:2.0:1784584234.764172:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 14 00000100:00100000:2.0:1784584234.764183:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+7:18179:x1871271580289536:12345-192.168.203.51@tcp:41:lfs.0 00000004:00000024:2.0:1784584234.764236:0:23817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1784584234.764374:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+7:18179:x1871271580289536:12345-192.168.203.51@tcp:41:lfs.0 Request processed in 192us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584234.764382:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 14 00000100:00080000:3.0:1784584234.766351:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784584234.769557:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584234.769665:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580289664 00000100:00100000:2.0:1784584234.769678:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580289664 00000100:00100000:2.0:1784584234.769826:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 15 00000100:00100000:2.0:1784584234.769838:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+6:18179:x1871271580289664:12345-192.168.203.51@tcp:41:lfs.0 00000004:00000024:2.0:1784584234.769895:0:22748:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1784584234.770015:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+6:18179:x1871271580289664:12345-192.168.203.51@tcp:41:lfs.0 Request processed in 178us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584234.770024:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 15 00000100:00080000:3.0:1784584234.770212:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784584234.780983:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584234.787334:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580289792 00000100:00100000:1.0:1784584234.787355:0:24258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580289792 00000100:00100000:1.0:1784584234.787511:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00100000:1.0:1784584234.787535:0:24258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c235180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+6:18179:x1871271580289792:12345-192.168.203.51@tcp:13:lfs.0 00002000:00000024:1.0:1784584234.787587:0:24258:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784584234.787721:0:24258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c235180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+6:18179:x1871271580289792:12345-192.168.203.51@tcp:13:lfs.0 Request processed in 198us (6750us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584234.787741:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00080000:3.0:1784584234.788103:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784584234.790429:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584234.790574:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580289920 00000100:00100000:2.0:1784584234.790587:0:24258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580289920 00000100:00100000:2.0:1784584234.790723:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:2.0:1784584234.790744:0:24258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+6:18179:x1871271580289920:12345-192.168.203.51@tcp:13:lfs.0 00002000:00000024:2.0:1784584234.790788:0:24258:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1784584234.791173:0:24258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+6:18179:x1871271580289920:12345-192.168.203.51@tcp:13:lfs.0 Request processed in 431us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584234.791201:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00080000:3.0:1784584234.795030:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784584234.980818:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584234.981118:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580290048 00000100:00100000:0.0:1784584234.981131:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580290048 00000100:00100000:0.0:1784584234.981383:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 130 00000100:00100000:0.0:1784584234.981517:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42c9664f-6d9c-42f4-930b-fd8093c44492+10:18211:x1871271580290048:12345-192.168.203.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784584234.981541:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584234.981567:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b4332b8400/0xdab2421a42e49831 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee891 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584234.981627:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4332b8400/0xdab2421a42e49831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee891 expref: 11 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584234.981640:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b4332b8400/0xdab2421a42e49831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee891 expref: 11 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584234.981650:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b8400, rc 0) 00000100:00100000:0.0:1784584234.981994:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42c9664f-6d9c-42f4-930b-fd8093c44492+11:18211:x1871271580290048:12345-192.168.203.51@tcp:101:mount.lustre.0 Request processed in 600us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584234.982004:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 130 00010000:00010000:0.0:1784584234.989752:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584234.990054:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584234.990176:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580290176 00000100:00100000:3.0:1784584234.990189:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580290176 00000100:00100000:3.0:1784584234.990266:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 131 00000100:00100000:3.0:1784584234.990279:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42c9664f-6d9c-42f4-930b-fd8093c44492+11:18211:x1871271580290176:12345-192.168.203.51@tcp:501:mount.lustre.0 00000100:00100000:3.0:1784584234.990514:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42c9664f-6d9c-42f4-930b-fd8093c44492+11:18211:x1871271580290176:12345-192.168.203.51@tcp:501:mount.lustre.0 Request processed in 237us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584234.990523:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 131 00000100:00100000:1.0:1784584234.998719:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584234.998870:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580290304 00000100:00100000:0.0:1784584234.998883:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580290304 00000100:00100000:0.0:1784584234.998957:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 132 00000100:00100000:0.0:1784584234.998970:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42c9664f-6d9c-42f4-930b-fd8093c44492+11:18211:x1871271580290304:12345-192.168.203.51@tcp:503:mount.lustre.0 00000100:00100000:0.0:1784584234.999214:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42c9664f-6d9c-42f4-930b-fd8093c44492+11:18211:x1871271580290304:12345-192.168.203.51@tcp:503:mount.lustre.0 Request processed in 245us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584234.999225:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 132 00000100:00100000:2.0:1784584235.015432:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584235.015609:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580290432 00000100:00100000:1.0:1784584235.015622:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580290432 00000100:00100000:1.0:1784584235.015689:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 133 00000100:00100000:1.0:1784584235.015707:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42c9664f-6d9c-42f4-930b-fd8093c44492+11:18218:x1871271580290432:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784584235.015905:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42c9664f-6d9c-42f4-930b-fd8093c44492+11:18218:x1871271580290432:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 205us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584235.015914:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 133 00000100:00100000:2.0:1784584235.037971:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584235.038244:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580290560 00000100:00100000:0.0:1784584235.038258:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580290560 00000100:00100000:0.0:1784584235.038353:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 134 00000100:00100000:0.0:1784584235.038365:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42c9664f-6d9c-42f4-930b-fd8093c44492+11:18218:x1871271580290560:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784584235.038598:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42c9664f-6d9c-42f4-930b-fd8093c44492+11:18218:x1871271580290560:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 234us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584235.038617:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 134 00000100:00100000:0.0:1784584235.044161:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584235.044230:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580290688 00000100:00100000:3.0:1784584235.044243:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580290688 00000100:00100000:3.0:1784584235.044331:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 135 00000100:00100000:3.0:1784584235.044343:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42c9664f-6d9c-42f4-930b-fd8093c44492+11:18218:x1871271580290688:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784584235.045005:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42c9664f-6d9c-42f4-930b-fd8093c44492+11:18218:x1871271580290688:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 661us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584235.045025:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 135 00000100:00100000:2.0:1784584235.051687:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584235.051800:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580290816 00000100:00100000:1.0:1784584235.051814:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580290816 00000100:00100000:1.0:1784584235.051889:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 136 00000100:00100000:1.0:1784584235.051901:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42c9664f-6d9c-42f4-930b-fd8093c44492+11:18211:x1871271580290816:12345-192.168.203.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784584235.051925:0:22741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584235.051950:0:22741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b303b1d400/0xdab2421a42e49838 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee8c2 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584235.051988:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b303b1d400/0xdab2421a42e49838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee8c2 expref: 12 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584235.052001:0:22741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b303b1d400/0xdab2421a42e49838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee8c2 expref: 12 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584235.052286:0:22741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1d400, rc 0) 00000100:00100000:1.0:1784584235.052383:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42c9664f-6d9c-42f4-930b-fd8093c44492+12:18211:x1871271580290816:12345-192.168.203.51@tcp:101:mount.lustre.0 Request processed in 483us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584235.052392:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 136 00000100:00100000:2.0:1784584235.056588:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584235.056685:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580290944 00000100:00100000:3.0:1784584235.056697:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580290944 00000100:00100000:3.0:1784584235.056771:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 137 00000100:00100000:3.0:1784584235.056782:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42c9664f-6d9c-42f4-930b-fd8093c44492+12:18211:x1871271580290944:12345-192.168.203.51@tcp:256:mount.lustre.0 20000000:01000000:3.0:1784584235.056816:0:22740:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1784584235.056851:0:22740:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1784584235.056856:0:22740:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1784584235.056859:0:22740:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1784584235.056862:0:22740:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1784584235.056865:0:22740:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1784584235.058796:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42c9664f-6d9c-42f4-930b-fd8093c44492+12:18211:x1871271580290944:12345-192.168.203.51@tcp:256:mount.lustre.0 Request processed in 2004us (2211us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584235.058811:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 137 00000100:00100000:2.0:1784584235.061756:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584235.062203:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580291072 00000100:00100000:0.0:1784584235.062217:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580291072 00000100:00100000:0.0:1784584235.062357:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 138 00000100:00100000:0.0:1784584235.062370:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42c9664f-6d9c-42f4-930b-fd8093c44492+12:18211:x1871271580291072:12345-192.168.203.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784584235.062393:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584235.062418:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b4332b9800/0xdab2421a42e4983f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee8c9 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584235.062457:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4332b9800/0xdab2421a42e4983f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee8c9 expref: 13 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584235.062503:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b4332b9800/0xdab2421a42e4983f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee8c9 expref: 13 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584235.062514:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b9800, rc 0) 00000100:00100000:0.0:1784584235.062597:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42c9664f-6d9c-42f4-930b-fd8093c44492+13:18211:x1871271580291072:12345-192.168.203.51@tcp:101:mount.lustre.0 Request processed in 231us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584235.062606:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 138 00000100:00100000:2.0:1784584235.064777:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584235.064873:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580291200 00000100:00100000:3.0:1784584235.064886:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580291200 00000100:00100000:3.0:1784584235.064954:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 139 00000100:00100000:3.0:1784584235.064964:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42c9664f-6d9c-42f4-930b-fd8093c44492+13:18211:x1871271580291200:12345-192.168.203.51@tcp:501:mount.lustre.0 00000100:00100000:3.0:1784584235.065179:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42c9664f-6d9c-42f4-930b-fd8093c44492+13:18211:x1871271580291200:12345-192.168.203.51@tcp:501:mount.lustre.0 Request processed in 216us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584235.065189:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 139 00000100:00100000:2.0:1784584235.069271:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584235.069385:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580291328 00000100:00100000:1.0:1784584235.069399:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580291328 00000100:00100000:1.0:1784584235.069522:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 140 00000100:00100000:1.0:1784584235.069533:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42c9664f-6d9c-42f4-930b-fd8093c44492+13:18211:x1871271580291328:12345-192.168.203.51@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784584235.069727:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42c9664f-6d9c-42f4-930b-fd8093c44492+13:18211:x1871271580291328:12345-192.168.203.51@tcp:503:mount.lustre.0 Request processed in 195us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584235.069737:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 140 00000100:00100000:2.0:1784584235.078817:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584235.079794:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580291456 00000100:00100000:1.0:1784584235.079809:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580291456 00000100:00100000:1.0:1784584235.079945:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 141 00000100:00100000:1.0:1784584235.079958:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42c9664f-6d9c-42f4-930b-fd8093c44492+13:18222:x1871271580291456:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784584235.080176:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42c9664f-6d9c-42f4-930b-fd8093c44492+13:18222:x1871271580291456:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 220us (1372us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584235.080186:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 141 00000100:00100000:2.0:1784584235.090032:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584235.098182:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580291584 00000100:00100000:3.0:1784584235.098204:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580291584 00000100:00100000:3.0:1784584235.098292:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 142 00000100:00100000:3.0:1784584235.098305:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42c9664f-6d9c-42f4-930b-fd8093c44492+13:18222:x1871271580291584:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784584235.098585:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42c9664f-6d9c-42f4-930b-fd8093c44492+13:18222:x1871271580291584:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 282us (8567us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584235.098594:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 142 00000100:00100000:2.0:1784584235.112649:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584235.112774:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580291712 00000100:00100000:0.0:1784584235.112787:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580291712 00000100:00100000:0.0:1784584235.112850:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:0.0:1784584235.112860:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1871271580291712:12345-192.168.203.51@tcp:38:mount.lustre.0 00010000:00080000:0.0:1784584235.112897:0:23817:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 4582ced1-2e60-4215-b04a-25e91daf3166@192.168.203.51@tcp t0 exp 0000000000000000 cur 678 last 0 00000020:00000080:0.0:1784584235.112947:0:23817:0:(genops.c:1406:class_connect()) connect: client 4582ced1-2e60-4215-b04a-25e91daf3166, cookie 0xdab2421a42e49846 00000004:00100000:0.0:1784584235.113000:0:23817:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1784584235.113120:0:23817:0:(import.c:65:import_set_state_nolock()) ffff98b30361a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784584235.113226:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4582ced1-2e60-4215-b04a-25e91daf3166+6:2397:x1871271580291712:12345-192.168.203.51@tcp:38:mount.lustre.0 Request processed in 365us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584235.113235:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:2.0:1784584235.114959:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584235.115214:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580291968 00000100:00100000:3.0:1784584235.115225:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580291968 00000100:00100000:3.0:1784584235.115280:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:3.0:1784584235.115290:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1871271580291968:12345-192.168.203.51@tcp:38:mount.lustre.0 00010000:00080000:3.0:1784584235.115341:0:22748:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 4582ced1-2e60-4215-b04a-25e91daf3166@192.168.203.51@tcp t0 exp 0000000000000000 cur 678 last 0 00000020:00000080:3.0:1784584235.115390:0:22748:0:(genops.c:1406:class_connect()) connect: client 4582ced1-2e60-4215-b04a-25e91daf3166, cookie 0xdab2421a42e4984d 00000004:00100000:3.0:1784584235.115433:0:22748:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1784584235.115681:0:22748:0:(import.c:65:import_set_state_nolock()) ffff98b41e83e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784584235.115795:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4582ced1-2e60-4215-b04a-25e91daf3166+6:2397:x1871271580291968:12345-192.168.203.51@tcp:38:mount.lustre.0 Request processed in 504us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584235.115804:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:2.0:1784584235.139579:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584235.139811:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580291840 00000100:00100000:0.0:1784584235.139841:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580291840 00000100:00100000:0.0:1784584235.139949:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:0.0:1784584235.139963:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302b47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4582ced1-2e60-4215-b04a-25e91daf3166+6:0:x1871271580291840:12345-192.168.203.51@tcp:41:mount.lustre.0 00000100:00080000:3.0:1784584235.139968:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1784584235.140018:0:23817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1784584235.140114:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302b47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4582ced1-2e60-4215-b04a-25e91daf3166+6:0:x1871271580291840:12345-192.168.203.51@tcp:41:mount.lustre.0 Request processed in 155us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584235.140122:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:2.0:1784584235.142127:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584235.142537:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580292224 00000100:00100000:1.0:1784584235.142552:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580292224 00000100:00100000:1.0:1784584235.142620:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 19 00000100:00100000:1.0:1784584235.142632:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4582ced1-2e60-4215-b04a-25e91daf3166+6:18211:x1871271580292224:12345-192.168.203.51@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784584235.142670:0:22749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1784584235.142764:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4582ced1-2e60-4215-b04a-25e91daf3166+6:18211:x1871271580292224:12345-192.168.203.51@tcp:41:mount.lustre.0 Request processed in 134us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584235.142773:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 19 00000100:00100000:2.0:1784584235.151058:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584235.151198:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580292352 00000100:00100000:3.0:1784584235.151208:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580292352 00000100:00100000:3.0:1784584235.151269:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 20 00000100:00100000:3.0:1784584235.151280:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b302426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4582ced1-2e60-4215-b04a-25e91daf3166+6:18211:x1871271580292352:12345-192.168.203.51@tcp:40:mount.lustre.0 00000100:00100000:3.0:1784584235.151382:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b302426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4582ced1-2e60-4215-b04a-25e91daf3166+6:18211:x1871271580292352:12345-192.168.203.51@tcp:40:mount.lustre.0 Request processed in 104us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584235.151391:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 20 00000100:00100000:2.0:1784584235.151449:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584235.152275:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580292096 00000100:00100000:1.0:1784584235.152282:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580292096 00000100:00100000:1.0:1784584235.152352:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00100000:1.0:1784584235.152361:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4582ced1-2e60-4215-b04a-25e91daf3166+6:0:x1871271580292096:12345-192.168.203.51@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784584235.152386:0:22749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784584235.152452:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4582ced1-2e60-4215-b04a-25e91daf3166+6:0:x1871271580292096:12345-192.168.203.51@tcp:41:mount.lustre.0 Request processed in 91us (1347us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584235.152459:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00080000:3.0:1784584235.152684:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784584235.153908:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584235.154044:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580292736 00000100:00100000:1.0:1784584235.154052:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580292736 00000100:00100000:1.0:1784584235.154100:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 143 00000100:00100000:1.0:1784584235.154120:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42c9664f-6d9c-42f4-930b-fd8093c44492+13:2398:x1871271580292736:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784584235.154187:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42c9664f-6d9c-42f4-930b-fd8093c44492+13:2398:x1871271580292736:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 69us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584235.154195:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 143 00000100:00100000:2.0:1784584235.154490:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584235.154544:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580292864 00000100:00100000:3.0:1784584235.154549:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580292864 00000100:00100000:3.0:1784584235.154600:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 32 00000100:00100000:3.0:1784584235.154608:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+7:2398:x1871271580292864:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784584235.154878:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584235.154908:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584235.154946:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584235.155055:0:25386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580293120 00000100:00100000:0.0:1784584235.155055:0:24253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580293248 00000100:00100000:1.0:1784584235.155059:0:25386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580293120 00000100:00100000:0.0:1784584235.155059:0:24253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580293248 00000100:00100000:1.0:1784584235.155092:0:25386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 2 00000100:00100000:0.0:1784584235.155097:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 3 00000100:00100000:1.0:1784584235.155099:0:25386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+6:2398:x1871271580293120:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784584235.155113:0:24253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+6:2398:x1871271580293248:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784584235.155135:0:25386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+6:2398:x1871271580293120:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 36us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584235.155142:0:25386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 2 00000100:00100000:0.0:1784584235.155150:0:24253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+6:2398:x1871271580293248:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 47us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584235.155156:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 3 00000100:00100000:1.0:1784584235.155170:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580292992 00000100:00100000:1.0:1784584235.155174:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580292992 00000100:00100000:1.0:1784584235.155197:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 33 00000100:00100000:1.0:1784584235.155329:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43efab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+6:2398:x1871271580292992:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784584235.155353:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+7:2398:x1871271580292864:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 745us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584235.155354:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43efab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+6:2398:x1871271580292992:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 152us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584235.155360:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 33 00000100:00100000:3.0:1784584235.155367:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 32 00000100:00100000:0.0:1784584235.155780:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584235.156369:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584235.158028:0:25386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580292480 00000100:00100000:1.0:1784584235.158040:0:25386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580292480 00000100:00100000:1.0:1784584235.158092:0:25386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580292608 00000100:00100000:1.0:1784584235.158096:0:25386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580292608 00000100:00100000:1.0:1784584235.158121:0:25386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:1.0:1784584235.158129:0:25386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c237480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2397:x1871271580292480:12345-192.168.203.51@tcp:8:mount.lustre.0 00000100:00100000:0.0:1784584235.158134:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 19 00000100:00100000:0.0:1784584235.158139:0:24253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41ea26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2397:x1871271580292608:12345-192.168.203.51@tcp:8:mount.lustre.0 00010000:00080000:1.0:1784584235.158171:0:25386:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 4582ced1-2e60-4215-b04a-25e91daf3166@192.168.203.51@tcp t0 exp 0000000000000000 cur 678 last 0 00000020:00000080:1.0:1784584235.158200:0:25386:0:(genops.c:1406:class_connect()) connect: client 4582ced1-2e60-4215-b04a-25e91daf3166, cookie 0xdab2421a42e49854 00002000:00100000:1.0:1784584235.158212:0:25386:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4582ced1-2e60-4215-b04a-25e91daf3166/ffff98b303a68800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784584235.158223:0:25386:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784584235.158287:0:25386:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784584235.158325:0:25386:0:(import.c:65:import_set_state_nolock()) ffff98b303a6c800 : changing import state from RECOVER to FULL 00010000:00080000:0.0:1784584235.158366:0:24253:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 4582ced1-2e60-4215-b04a-25e91daf3166@192.168.203.51@tcp t0 exp 0000000000000000 cur 678 last 0 00000100:00100000:1.0:1784584235.158391:0:25386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c237480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4582ced1-2e60-4215-b04a-25e91daf3166+6:2397:x1871271580292480:12345-192.168.203.51@tcp:8:mount.lustre.0 Request processed in 262us (2612us total) trans 0 rc 0/0 00000020:00000080:0.0:1784584235.158392:0:24253:0:(genops.c:1406:class_connect()) connect: client 4582ced1-2e60-4215-b04a-25e91daf3166, cookie 0xdab2421a42e4985b 00002000:00100000:0.0:1784584235.158398:0:24253:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4582ced1-2e60-4215-b04a-25e91daf3166/ffff98b30361c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:1.0:1784584235.158400:0:25386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 18 00002000:00100000:0.0:1784584235.158404:0:24253:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784584235.158438:0:24253:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784584235.158453:0:24253:0:(import.c:65:import_set_state_nolock()) ffff98b30361b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784584235.158618:0:24253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41ea26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4582ced1-2e60-4215-b04a-25e91daf3166+6:2397:x1871271580292608:12345-192.168.203.51@tcp:8:mount.lustre.0 Request processed in 378us (2151us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584235.158627:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 19 00000100:00100000:1.0:1784584235.160699:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584235.160756:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580293376 00000100:00100000:0.0:1784584235.160764:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580293376 00000100:00100000:0.0:1784584235.160818:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 4 00000100:00100000:0.0:1784584235.160940:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4582ced1-2e60-4215-b04a-25e91daf3166+6:18211:x1871271580293376:12345-192.168.203.51@tcp:900:mount.lustre.0 00000100:00100000:0.0:1784584235.161005:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4582ced1-2e60-4215-b04a-25e91daf3166+6:18211:x1871271580293376:12345-192.168.203.51@tcp:900:mount.lustre.0 Request processed in 68us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584235.167793:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 4 00000100:00100000:0.0:1784584235.175889:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584235.176071:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580293504 00000100:00100000:1.0:1784584235.176081:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580293504 00000100:00100000:1.0:1784584235.176132:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 1 00000100:00100000:1.0:1784584235.176142:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c235880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4582ced1-2e60-4215-b04a-25e91daf3166+6:18211:x1871271580293504:12345-192.168.203.51@tcp:33:mount.lustre.0 00000004:00200000:1.0:1784584235.176227:0:22751:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1784584235.176310:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c235880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4582ced1-2e60-4215-b04a-25e91daf3166+6:18211:x1871271580293504:12345-192.168.203.51@tcp:33:mount.lustre.0 Request processed in 169us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584235.176327:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 1 00000100:00100000:1.0:1784584235.341033:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584235.341107:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580293632 00000100:00100000:2.0:1784584235.341117:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580293632 00000100:00100000:2.0:1784584235.341207:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 22 00000100:00100000:2.0:1784584235.341217:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4582ced1-2e60-4215-b04a-25e91daf3166+6:18245:x1871271580293632:12345-192.168.203.51@tcp:101:mkdir.0 00010000:00010000:2.0:1784584235.341254:0:22748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584235.341277:0:22748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49862 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee8fa expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584235.341352:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e49869 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584235.341366:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e49869 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584235.341379:0:22748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e49869 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584235.341428:0:22748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784584235.341432:0:22748:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784584235.341452:0:22748:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e49869 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584235.341500:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49862 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee8fa expref: 8 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584235.341517:0:22748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e49869 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee8fa expref: 7 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584235.341525:0:22748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b43e8ab600) 00010000:00010000:2.0:1784584235.341528:0:22748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784584235.341531:0:22748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c1800, rc 0) 00000100:00100000:2.0:1784584235.341596:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4582ced1-2e60-4215-b04a-25e91daf3166+7:18245:x1871271580293632:12345-192.168.203.51@tcp:101:mkdir.0 Request processed in 381us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584235.341602:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 22 00000100:00100000:2.0:1784584235.693629:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784584235.693651:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599262720:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784584235.693727:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584235.693778:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b41ea25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599262592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784584235.693800:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584235.699173:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599263104:0@lo:400:kworker.0 00000100:00100000:1.0:1784584235.699241:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584235.701824:0:23818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599263104 00000100:00100000:2.0:1784584235.701839:0:23818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599263104 00000100:00100000:2.0:1784584235.701906:0:23818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784584235.701918:0:23818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599263104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584235.701999:0:23818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599263104:12345-0@lo:400:kworker.0 Request processed in 84us (2758us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584235.702007:0:23818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784584235.702032:0:24257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599262720 00000100:00100000:2.0:1784584235.702036:0:24257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599262720 00000100:00100000:2.0:1784584235.702068:0:24257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599262592 00000100:00100000:2.0:1784584235.702071:0:24257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599262592 00000100:00100000:2.0:1784584235.702089:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784584235.702095:0:24257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41ea27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599262720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784584235.702111:0:24257:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1784584235.702144:0:24257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41ea27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599262720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (8417us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584235.702150:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784584235.702162:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784584235.702169:0:24257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41ea27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599262592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784584235.702179:0:24257:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784584235.702205:0:24257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41ea27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599262592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (8404us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584235.702227:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1784584235.702247:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784584235.702251:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784584235.702292:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b41ea25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599262592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784584235.702329:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599263232:0@lo:400:kworker.0 00000100:00100000:2.0:1784584235.702363:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584235.702390:0:24895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599263232 00000100:00100000:2.0:1784584235.702393:0:24895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599263232 00000100:00100000:2.0:1784584235.702424:0:24895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784584235.702431:0:24895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41ea25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3642:x1871271599263232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584235.702461:0:24895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41ea25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3642:x1871271599263232:12345-0@lo:400:kworker.0 Request processed in 30us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584235.702486:0:24895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1784584235.702499:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784584235.702522:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599263232:0@lo:400:kworker.0 00000100:00100000:2.0:1784584235.702529:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599263744:0@lo:400:kworker.0 00000100:00100000:2.0:1784584235.702553:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584235.702570:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1871271599264256:0@lo:400:kworker.0 00000100:00100000:2.0:1784584235.702591:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584235.702614:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599262720:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784584235.702636:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599263744 00000100:00100000:2.0:1784584235.702639:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599263744 00000100:00100000:2.0:1784584235.702659:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599264256 00000100:00100000:2.0:1784584235.702662:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599264256 00000100:00100000:2.0:1784584235.702689:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784584235.702702:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41ea27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599263744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584235.702735:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41ea27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599263744:12345-0@lo:400:kworker.0 Request processed in 34us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584235.702741:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784584235.702752:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784584235.702757:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41ea24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871271599264256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584235.702777:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41ea24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871271599264256:12345-0@lo:400:kworker.0 Request processed in 21us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584235.702782:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1784584235.702795:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784584235.702812:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599263744:0@lo:400:kworker.0 00010000:00080000:2.0:1784584235.702823:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303852300 x1871271599264256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584235.702831:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1871271599264256:0@lo:400:kworker.0 00000100:00100000:2.0:1784584235.702899:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:954867da-9a7c-4a17-b608-74c1de1cda93:3640:1871271599262976:0@lo:400:kworker.0 00000100:00100000:2.0:1784584235.702924:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584235.702945:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599263488:0@lo:400:kworker.0 00000100:00100000:2.0:1784584235.702964:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584235.702980:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1871271599264000:0@lo:400:kworker.0 00000100:00100000:2.0:1784584235.702998:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584235.703015:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1784584235.703020:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599262848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784584235.703040:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584235.703055:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599263360:0@lo:400:kworker.0 00000100:00100000:2.0:1784584235.703084:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584235.703100:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599263872:0@lo:400:kworker.0 00000100:00100000:2.0:1784584235.703118:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584235.703140:0:24257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599262848 00000100:00100000:2.0:1784584235.703144:0:24257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599262848 00000100:00100000:2.0:1784584235.703165:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784584235.703171:0:24257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1871271599262848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784584235.703195:0:24257:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1784584235.703230:0:24257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1871271599262848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584235.703236:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784584235.703264:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599262848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784584235.703282:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599264000 00000100:00100000:2.0:1784584235.703285:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599264000 00000100:00100000:2.0:1784584235.703306:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599263360 00000100:00100000:2.0:1784584235.703309:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599263360 00000100:00100000:2.0:1784584235.703334:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599263872 00000100:00100000:2.0:1784584235.703337:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599263872 00000100:00100000:2.0:1784584235.703350:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784584235.703355:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871271599264000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584235.703390:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871271599264000:12345-0@lo:400:kworker.0 Request processed in 34us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584235.703395:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784584235.703407:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784584235.703413:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599263360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584235.703439:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871271599263360:12345-0@lo:400:kworker.0 Request processed in 27us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584235.703451:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784584235.703464:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784584235.703493:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599263872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584235.703523:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599263872:12345-0@lo:400:kworker.0 Request processed in 31us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584235.703528:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1784584235.703541:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784584235.703544:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784584235.703559:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871271599263360:0@lo:400:kworker.0 00000100:00100000:2.0:1784584235.703569:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599263872:0@lo:400:kworker.0 00010000:00080000:2.0:1784584235.703578:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303851c00 x1871271599264000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584235.703587:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1871271599264000:0@lo:400:kworker.0 00000100:00100000:1.0:1784584235.704001:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599263104:0@lo:400:kworker.0 00000100:00100000:1.0:1784584235.704009:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599263616:0@lo:400:kworker.0 00000100:00100000:1.0:1784584235.704038:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584235.704064:0:24254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599263616 00000100:00100000:1.0:1784584235.704067:0:24254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599263616 00000100:00100000:1.0:1784584235.704100:0:24254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784584235.704101:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599262976 00000100:00100000:2.0:1784584235.704105:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599262976 00000100:00100000:1.0:1784584235.704106:0:24254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599263616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584235.704129:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1784584235.704135:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+24:3640:x1871271599262976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584235.704136:0:24254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599263616:12345-0@lo:400:kworker.0 Request processed in 31us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584235.704142:0:24254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1784584235.704157:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784584235.704166:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+24:3640:x1871271599262976:12345-0@lo:400:kworker.0 Request processed in 31us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584235.704171:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1784584235.704176:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599263616:0@lo:400:kworker.0 00000100:00100000:1.0:1784584235.704182:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599264128:0@lo:400:kworker.0 00000100:00100000:2.0:1784584235.704192:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:954867da-9a7c-4a17-b608-74c1de1cda93:3640:1871271599262976:0@lo:400:kworker.0 00000100:00100000:1.0:1784584235.704206:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584235.704223:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599264128 00000100:00100000:2.0:1784584235.704224:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599263488 00000100:00100000:1.0:1784584235.704226:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599264128 00000100:00100000:2.0:1784584235.704227:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599263488 00000100:00100000:2.0:1784584235.704248:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784584235.704248:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784584235.704253:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599264128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584235.704258:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b41ea26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599263488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584235.704282:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599264128:12345-0@lo:400:kworker.0 Request processed in 29us (75us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584235.704285:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b41ea26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599263488:12345-0@lo:400:kworker.0 Request processed in 28us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584235.704288:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784584235.704291:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1784584235.704300:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584235.704325:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599263488:0@lo:400:kworker.0 00000100:00100000:1.0:1784584235.704327:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599264128:0@lo:400:kworker.0 00000001:00100000:0.0:1784584235.720072:0:25070:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4582ced1-2e60-4215-b04a-25e91daf3166 00000001:00100000:0.0:1784584235.720087:0:25070:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 341d21c5-fdb2-43c1-8bba-09bf4a7f7165 00000001:00080000:0.0:1784584235.720096:0:25070:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:1.0:1784584236.014854:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784584236.722335:0:24250:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4582ced1-2e60-4215-b04a-25e91daf3166 00000001:00100000:2.0:1784584236.722350:0:24250:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 341d21c5-fdb2-43c1-8bba-09bf4a7f7165 00010000:00010000:2.0:1784584237.039257:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784584237.490057:0:22782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1784584237.745061:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599264384:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784584237.745131:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584237.746009:0:24257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599264384 00000100:00100000:0.0:1784584237.746018:0:24257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599264384 00000100:00100000:0.0:1784584237.746076:0:24257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784584237.746086:0:24257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599264384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784584237.746116:0:24257:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:1.0:1784584237.750000:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784584237.754036:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599264384:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784584237.755015:0:24257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599264384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 8924us (9877us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584237.755035:0:24257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000001:02000400:3.0:1784584237.807723:0:25630:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1784584238.063275:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584238.767234:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784584238.767266:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599264512:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784584238.767369:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584238.767427:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599264512 00000100:00100000:2.0:1784584238.767436:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599264512 00000100:00100000:2.0:1784584238.767513:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784584238.767522:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599264512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784584238.767563:0:22753:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1784584238.767613:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599264512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584238.767622:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784584238.767685:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599264512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784584238.768083:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599264640:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784584238.768126:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584238.768743:0:23818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599264640 00000100:00100000:3.0:1784584238.768752:0:23818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599264640 00000100:00100000:3.0:1784584238.768797:0:23818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784584238.768805:0:23818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599264640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784584238.768834:0:23818:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1784584238.768895:0:23818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599264640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584238.768903:0:23818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784584238.769036:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599264640:0@lo:41:osp-pre-1-0.0 00000001:00100000:0.0:1784584238.770825:0:23481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 4582ced1-2e60-4215-b04a-25e91daf3166 00000001:00100000:0.0:1784584238.770846:0:23481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 341d21c5-fdb2-43c1-8bba-09bf4a7f7165 00000001:00100000:3.0:1784584238.772270:0:22727:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4582ced1-2e60-4215-b04a-25e91daf3166 00000001:00100000:3.0:1784584238.772280:0:22727:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 341d21c5-fdb2-43c1-8bba-09bf4a7f7165 00010000:00010000:1.0:1784584239.085748:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784584239.726769:0:23502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784584240.112741:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584240.222333:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584240.222389:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584240.222419:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584240.222442:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584240.222491:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584240.222557:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584240.222574:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580293760 00000100:00100000:0.0:1784584240.222585:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580293760 00000100:00100000:3.0:1784584240.222602:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584240.222636:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 145 00000100:00100000:0.0:1784584240.222645:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42c9664f-6d9c-42f4-930b-fd8093c44492+13:2398:x1871271580293760:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784584240.222654:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584240.222687:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584240.222717:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580294016 00000100:00100000:0.0:1784584240.222722:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42c9664f-6d9c-42f4-930b-fd8093c44492+13:2398:x1871271580293760:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 76us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584240.222723:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580294016 00000100:00100000:0.0:1784584240.222733:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 145 00000100:00100000:3.0:1784584240.222771:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580294528 00000100:00080000:2.0:1784584240.222776:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784584240.222800:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580294528 00000100:00100000:3.0:1784584240.222836:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580293888 00000100:00100000:3.0:1784584240.222840:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580293888 00000100:00100000:3.0:1784584240.222862:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580294400 00000100:00100000:3.0:1784584240.222865:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580294400 00000100:00100000:1.0:1784584240.222877:0:24254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580294272 00000100:00100000:1.0:1784584240.222883:0:24254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580294272 00000100:00100000:3.0:1784584240.222887:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 40 00000100:00100000:3.0:1784584240.222898:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+5:2398:x1871271580294016:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784584240.222917:0:24254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580294784 00000100:00100000:1.0:1784584240.222922:0:24254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580294784 00000100:00100000:3.0:1784584240.222951:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+5:2398:x1871271580294016:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 56us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584240.222958:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 40 00000100:00100000:3.0:1784584240.222973:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 41 00000100:00100000:3.0:1784584240.222979:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4582ced1-2e60-4215-b04a-25e91daf3166+5:2398:x1871271580294528:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784584240.223004:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4582ced1-2e60-4215-b04a-25e91daf3166+5:2398:x1871271580294528:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 25us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584240.223021:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 41 00000100:00100000:3.0:1784584240.223032:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 42 00000100:00100000:3.0:1784584240.223039:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+6:2398:x1871271580293888:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784584240.223072:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+6:2398:x1871271580293888:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 34us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584240.223079:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 42 00000100:00100000:3.0:1784584240.223105:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 43 00000100:00100000:3.0:1784584240.223114:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4582ced1-2e60-4215-b04a-25e91daf3166+6:2398:x1871271580294400:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784584240.223154:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4582ced1-2e60-4215-b04a-25e91daf3166+6:2398:x1871271580294400:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 41us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584240.223161:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 43 00000100:00100000:3.0:1784584240.223179:0:24253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580294144 00000100:00100000:3.0:1784584240.223183:0:24253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580294144 00000100:00080000:2.0:1784584240.223189:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784584240.223202:0:24253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580294656 00000100:00100000:3.0:1784584240.223205:0:24253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580294656 00000100:00100000:3.0:1784584240.223218:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00100000:3.0:1784584240.223225:0:24253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+5:2398:x1871271580294272:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784584240.223250:0:24253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+5:2398:x1871271580294272:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 26us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584240.223258:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00080000:2.0:1784584240.223261:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784584240.223265:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784584240.223268:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784584240.223275:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:3.0:1784584240.223293:0:24253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+5:2398:x1871271580294144:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784584240.223320:0:24253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+5:2398:x1871271580294144:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 38us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584240.223327:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:3.0:1784584240.223341:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:3.0:1784584240.223348:0:24253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4582ced1-2e60-4215-b04a-25e91daf3166+5:2398:x1871271580294656:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1784584240.223373:0:24253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4582ced1-2e60-4215-b04a-25e91daf3166+5:2398:x1871271580294656:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 26us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584240.223379:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00080000:0.0:1784584240.224079:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784584240.224083:0:24254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:1.0:1784584240.224254:0:24254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4582ced1-2e60-4215-b04a-25e91daf3166+5:2398:x1871271580294784:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1784584240.224316:0:24254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4582ced1-2e60-4215-b04a-25e91daf3166+5:2398:x1871271580294784:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 225us (1850us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584240.224324:0:24254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:0.0:1784584240.813789:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:954867da-9a7c-4a17-b608-74c1de1cda93:3642:1871271599264768:0@lo:400:kworker.0 00000100:00100000:0.0:1784584240.813884:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584240.814018:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599264896:0@lo:400:kworker.0 00000100:00100000:0.0:1784584240.814057:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584240.814115:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599264896 00000100:00100000:0.0:1784584240.814122:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599264896 00000100:00100000:0.0:1784584240.814188:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784584240.814206:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599264896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584240.814274:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599264896:12345-0@lo:400:kworker.0 Request processed in 70us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584240.814294:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784584240.814343:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599264896:0@lo:400:kworker.0 00000100:00100000:0.0:1784584240.814403:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784584240.814418:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43c234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599265024:0@lo:400:kworker.0 00000100:00100000:0.0:1784584240.814513:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584240.814561:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599265152:0@lo:400:kworker.0 00000100:00100000:0.0:1784584240.814585:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584240.814653:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599265280:0@lo:400:kworker.0 00000100:00100000:0.0:1784584240.814688:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584240.814730:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599265408:0@lo:400:kworker.0 00000100:00100000:0.0:1784584240.814751:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584240.814793:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599265408 00000100:00100000:0.0:1784584240.814797:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599265408 00000100:00100000:0.0:1784584240.814842:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784584240.814849:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599265408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584240.814886:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599265408:12345-0@lo:400:kworker.0 Request processed in 37us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584240.814893:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784584240.814927:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599265408:0@lo:400:kworker.0 00000100:00100000:0.0:1784584240.814965:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784584240.814972:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599265536:0@lo:400:kworker.0 00000100:00100000:0.0:1784584240.815002:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584240.815059:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599265664:0@lo:400:kworker.0 00000100:00100000:0.0:1784584240.815088:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584240.815125:0:24254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599265024 00000100:00100000:0.0:1784584240.815129:0:24254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599265024 00000100:00100000:0.0:1784584240.815172:0:24254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599265152 00000100:00100000:0.0:1784584240.815182:0:24254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599265152 00000100:00100000:0.0:1784584240.815201:0:24254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599265536 00000100:00100000:0.0:1784584240.815203:0:24254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599265536 00000100:00100000:0.0:1784584240.815214:0:24254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599265664 00000100:00100000:0.0:1784584240.815216:0:24254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599265664 00000100:00100000:0.0:1784584240.815237:0:24254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784584240.815244:0:24254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43c8ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599265024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584240.815307:0:24254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43c8ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599265024:12345-0@lo:400:kworker.0 Request processed in 62us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584240.815313:0:24254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784584240.815324:0:24254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784584240.815329:0:24254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599265152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584240.815375:0:24254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599265152:12345-0@lo:400:kworker.0 Request processed in 46us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584240.815381:0:24254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784584240.815398:0:24254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784584240.815404:0:24254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599265536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584240.815433:0:24254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599265536:12345-0@lo:400:kworker.0 Request processed in 30us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584240.815438:0:24254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784584240.815447:0:24254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784584240.815459:0:24254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599265664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584240.815507:0:24254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599265664:12345-0@lo:400:kworker.0 Request processed in 49us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584240.815513:0:24254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1784584240.815536:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784584240.815539:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784584240.815569:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599265664:0@lo:400:kworker.0 00000100:00100000:0.0:1784584240.815578:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1784584240.815589:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599265152:0@lo:400:kworker.0 00000100:00100000:0.0:1784584240.815612:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599265536:0@lo:400:kworker.0 00000100:00100000:0.0:1784584240.815632:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599265024:0@lo:400:kworker.0 00000100:00100000:0.0:1784584240.815674:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599265792:0@lo:400:kworker.0 00000100:00100000:0.0:1784584240.815700:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584240.815758:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599265920:0@lo:400:kworker.0 00000100:00100000:0.0:1784584240.815790:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584240.815837:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784584240.815843:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599266048:0@lo:400:kworker.0 00000100:00100000:0.0:1784584240.815868:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584240.815923:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599266176:0@lo:400:kworker.0 00000100:00100000:0.0:1784584240.815956:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584240.816005:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1871271599266304:0@lo:400:kworker.0 00000100:00100000:0.0:1784584240.816038:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584240.818335:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599265280 00000100:00100000:3.0:1784584240.818358:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599265280 00000100:00100000:3.0:1784584240.818420:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599265792 00000100:00100000:3.0:1784584240.818423:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599265792 00000100:00100000:3.0:1784584240.818437:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599265920 00000100:00100000:3.0:1784584240.818440:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599265920 00000100:00100000:3.0:1784584240.818482:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599266048 00000100:00100000:3.0:1784584240.818485:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599266048 00000100:00100000:3.0:1784584240.818500:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599266176 00000100:00100000:3.0:1784584240.818502:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599266176 00000100:00100000:3.0:1784584240.818513:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599266304 00000100:00100000:3.0:1784584240.818516:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599266304 00000100:00100000:3.0:1784584240.818534:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784584240.818544:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599265280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584240.818642:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871271599265280:12345-0@lo:400:kworker.0 Request processed in 99us (3952us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584240.818649:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784584240.818665:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784584240.818670:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599265792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584240.818700:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871271599265792:12345-0@lo:400:kworker.0 Request processed in 29us (2999us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584240.818706:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784584240.818716:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784584240.818722:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871271599265920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584240.818754:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871271599265920:12345-0@lo:400:kworker.0 Request processed in 32us (2964us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584240.818760:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784584240.818772:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784584240.818777:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599266048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584240.818820:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871271599266048:12345-0@lo:400:kworker.0 Request processed in 43us (2951us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584240.818826:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784584240.818837:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784584240.818843:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599266176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584240.818875:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871271599266176:12345-0@lo:400:kworker.0 Request processed in 32us (2918us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584240.818881:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784584240.818892:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784584240.818898:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871271599266304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584240.818924:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871271599266304:12345-0@lo:400:kworker.0 Request processed in 27us (2886us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584240.818930:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784584240.819004:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1871271599266176:0@lo:400:kworker.0 00010000:00080000:3.0:1784584240.819041:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b404954380 x1871271599266304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584240.819053:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1871271599266304:0@lo:400:kworker.0 00000100:00100000:3.0:1784584240.819064:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871271599265792:0@lo:400:kworker.0 00000100:00100000:3.0:1784584240.819074:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871271599265280:0@lo:400:kworker.0 00010000:00080000:3.0:1784584240.819100:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b404954e00 x1871271599266048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584240.819108:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1871271599266048:0@lo:400:kworker.0 00000100:00100000:3.0:1784584240.819130:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1871271599265920:0@lo:400:kworker.0 00000100:00080000:0.0:1784584240.822418:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784584240.822426:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784584240.823055:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599266432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784584240.823145:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584240.824594:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599264768 00000100:00100000:2.0:1784584240.824617:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599264768 00000100:00100000:2.0:1784584240.824712:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1784584240.824722:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+24:3642:x1871271599264768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584240.824811:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+24:3642:x1871271599264768:12345-0@lo:400:kworker.0 Request processed in 91us (10926us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584240.824819:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1784584240.828614:0:24257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599266432 00000100:00100000:0.0:1784584240.828630:0:24257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599266432 00000100:00100000:0.0:1784584240.828690:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784584240.828701:0:24258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599266432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784584240.828732:0:24258:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1784584240.828815:0:24258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599266432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (5669us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584240.828831:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784584240.828887:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599266432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784584240.839644:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599266560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784584240.839712:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584240.839764:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599266688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784584240.839790:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584240.839822:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599266560 00000100:00100000:2.0:1784584240.839829:0:24258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599266560 00000100:00100000:2.0:1784584240.839866:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599266688 00000100:00100000:2.0:1784584240.839869:0:24258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599266688 00000100:00100000:2.0:1784584240.839885:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784584240.839893:0:24258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599266560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784584240.839915:0:24258:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1784584240.839960:0:24258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599266560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584240.839967:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784584240.839986:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784584240.839992:0:24258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599266688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784584240.840010:0:24258:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784584240.840041:0:24258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599266688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584240.840047:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784584240.840098:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599266560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784584240.840126:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599266688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784584240.840148:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43c235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:954867da-9a7c-4a17-b608-74c1de1cda93:3642:1871271599264768:0@lo:400:kworker.0 00000020:00000080:3.0:1784584241.074710:0:25777:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea5aa0380 20000000:00000080:3.0:1784584241.074725:0:25777:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98b42f17d800 uarg=0000000000000000 20000000:01000000:3.0:1784584241.074763:0:25777:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1784584241.074768:0:25777:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1784584241.074773:0:25777:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1784584241.075155:0:25778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1784584241.075309:0:25777:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1784584241.088141:0:25777:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1784584241.088174:0:25777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98b43ebd9a00/0xdab2421a42e49870 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584241.088192:0:25777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b4332b8a00/0xdab2421a42e494cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e494c6 expref: 23 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584241.088199:0:25777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b303b1c200/0xdab2421a42e494db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e494d4 expref: 23 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584241.088206:0:25777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b43ea7aa00/0xdab2421a42e4951a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e49513 expref: 23 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584241.088211:0:25777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b418982c00/0xdab2421a42e495b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e495ad expref: 23 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584241.088219:0:25777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b303b1c400/0xdab2421a42e49800 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee859 expref: 12 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584241.088226:0:25777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98b4332b9800/0xdab2421a42e4983f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee8c9 expref: 12 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584241.088247:0:25777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98b43ebd9a00/0xdab2421a42e49870 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584241.088307:0:25777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b4332b9800/0xdab2421a42e4983f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee8c9 expref: 12 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584241.088321:0:25777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b4332b9800/0xdab2421a42e4983f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee8c9 expref: 12 pid: 22742 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584241.088335:0:25777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bc2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25777:1871271599266816:192.168.203.51@tcp:104: 00010000:00010000:3.0:1784584241.088557:0:25777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b303b1c400/0xdab2421a42e49800 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee859 expref: 12 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584241.088566:0:25777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b303b1c400/0xdab2421a42e49800 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee859 expref: 12 pid: 22741 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584241.088574:0:25777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bc2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25777:1871271599266944:192.168.203.51@tcp:104: 00010000:00010000:3.0:1784584241.088614:0:25777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b418982c00/0xdab2421a42e495b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e495ad expref: 23 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584241.088622:0:25777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b418982c00/0xdab2421a42e495b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e495ad expref: 23 pid: 22740 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584241.089033:0:25777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bc0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25777:1871271599267072:0@lo:104: 00000100:00100000:3.0:1784584241.089077:0:25777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784584241.089129:0:25777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b43ea7aa00/0xdab2421a42e4951a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e49513 expref: 23 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584241.089149:0:25777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b43ea7aa00/0xdab2421a42e4951a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e49513 expref: 23 pid: 22740 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584241.089158:0:25777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b436ec0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25777:1871271599267200:0@lo:104: 00000100:00100000:3.0:1784584241.089181:0:25777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584241.089208:0:22731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599267072 00000100:00100000:3.0:1784584241.089214:0:22731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599267072 00000100:00100000:3.0:1784584241.089250:0:22731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599267200 00000100:00100000:3.0:1784584241.089252:0:22731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599267200 00000100:00100000:3.0:1784584241.089264:0:22731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784584241.089271:0:22731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:954867da-9a7c-4a17-b608-74c1de1cda93+4:25777:x1871271599267072:12345-0@lo:104: 00010000:00010000:3.0:1784584241.089293:0:22731:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e495ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e495b4 expref: -99 pid: 25069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584241.089336:0:22731:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784584241.089341:0:22731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:954867da-9a7c-4a17-b608-74c1de1cda93+4:25777:x1871271599267072:12345-0@lo:104: Request processed in 72us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584241.089348:0:22731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784584241.089362:0:22731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784584241.089368:0:22731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b436ec3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:954867da-9a7c-4a17-b608-74c1de1cda93+3:25777:x1871271599267200:12345-0@lo:104: 00010000:00010000:3.0:1784584241.089374:0:22731:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e49513 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e4951a expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584241.089409:0:22731:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784584241.089415:0:22731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b436ec3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:954867da-9a7c-4a17-b608-74c1de1cda93+3:25777:x1871271599267200:12345-0@lo:104: Request processed in 47us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584241.089421:0:22731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1784584241.089456:0:25777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b303b1c200/0xdab2421a42e494db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e494d4 expref: 23 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584241.089464:0:25777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b303b1c200/0xdab2421a42e494db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e494d4 expref: 23 pid: 22740 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584241.089506:0:25777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b436ec2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25777:1871271599267328:0@lo:104: 00000100:00100000:3.0:1784584241.089528:0:25777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584241.089546:0:22731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599267328 00000100:00100000:3.0:1784584241.089551:0:22731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599267328 00000100:00100000:3.0:1784584241.089566:0:22731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784584241.089572:0:22731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b436ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:954867da-9a7c-4a17-b608-74c1de1cda93+3:25777:x1871271599267328:12345-0@lo:104: 00010000:00010000:3.0:1784584241.089579:0:22731:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ac00/0xdab2421a42e494d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e494db expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584241.089611:0:22731:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1784584241.089616:0:22731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b436ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:954867da-9a7c-4a17-b608-74c1de1cda93+3:25777:x1871271599267328:12345-0@lo:104: Request processed in 44us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584241.089622:0:22731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1784584241.090357:0:25088:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784584241.090365:0:25088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e495ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e495b4 expref: -99 pid: 25069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584241.090381:0:25088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7b200 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:1.0:1784584241.090385:0:25088:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e495ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e495b4 expref: -99 pid: 25069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584241.090394:0:25088:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e495ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e495b4 expref: -99 pid: 25069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784584241.090402:0:25088:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e495ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e495b4 expref: -99 pid: 25069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584241.090408:0:25088:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784584241.090454:0:25088:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e495ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e495b4 expref: -99 pid: 25069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584241.090460:0:25088:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784584241.090491:0:25088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e495ad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e495b4 expref: -99 pid: 25069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584241.090498:0:25088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b43ea7b200/0xdab2421a42e495ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e495b4 expref: -99 pid: 25069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584241.090514:0:25088:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784584241.090518:0:25088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e49513 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e4951a expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584241.090524:0:25088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b418983c00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:1.0:1784584241.090527:0:25088:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e49513 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e4951a expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584241.090534:0:25088:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e49513 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e4951a expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784584241.090540:0:25088:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e49513 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e4951a expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584241.090544:0:25088:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784584241.090557:0:25088:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e49513 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4951a expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584241.090563:0:25088:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784584241.090575:0:25088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e49513 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4951a expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584241.090592:0:25088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b418983c00/0xdab2421a42e49513 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e4951a expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584241.090602:0:25088:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584241.090606:0:25088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ac00/0xdab2421a42e494d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e494db expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584241.090612:0:25088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7ac00 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:1.0:1784584241.090615:0:25088:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ac00/0xdab2421a42e494d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e494db expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584241.090621:0:25088:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ac00/0xdab2421a42e494d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e494db expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584241.090755:0:25777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98b4332b8a00/0xdab2421a42e494cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdab2421a42e494c6 expref: 23 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584241.090764:0:25777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98b4332b8a00/0xdab2421a42e494cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdab2421a42e494c6 expref: 23 pid: 22741 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584241.090775:0:25777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b436ec3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25777:1871271599267712:0@lo:104: 00000100:00100000:3.0:1784584241.090810:0:25777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584241.090833:0:22731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599267712 10000000:00010000:1.0:1784584241.090942:0:25088:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ac00/0xdab2421a42e494d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e494db expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584241.090948:0:25088:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784584241.090964:0:25088:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ac00/0xdab2421a42e494d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e494db expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584241.090970:0:25088:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784584241.090977:0:25088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ac00/0xdab2421a42e494d4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e494db expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584241.090984:0:25088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b43ea7ac00/0xdab2421a42e494d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e494db expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584241.090993:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584241.091001:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584241.091003:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584241.091087:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584241.091113:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:954867da-9a7c-4a17-b608-74c1de1cda93:3642:1871271599267456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784584241.091141:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784584241.091179:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584241.091210:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599267456 00000100:00100000:1.0:1784584241.091214:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599267456 00010000:00010000:1.0:1784584241.091237:0:22734:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b418982c00/0xdab2421a42e495b4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e495ad expref: 24 pid: 22740 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584241.091261:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784584241.091269:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303850e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:954867da-9a7c-4a17-b608-74c1de1cda93+24:3642:x1871271599267456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784584241.091290:0:22734:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584241.091296:0:22734:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b418982c00/0xdab2421a42e495b4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e495ad expref: 24 pid: 22740 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584241.091305:0:22734:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b418982c00/0xdab2421a42e495b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e495ad expref: 24 pid: 22740 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584241.091321:0:22734:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584241.091350:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303850e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:954867da-9a7c-4a17-b608-74c1de1cda93+24:3642:x1871271599267456:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584241.091357:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784584241.091387:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:954867da-9a7c-4a17-b608-74c1de1cda93:3642:1871271599267456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784584241.091416:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:954867da-9a7c-4a17-b608-74c1de1cda93:3640:1871271599267840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784584241.091439:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584241.091457:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784584241.091527:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:954867da-9a7c-4a17-b608-74c1de1cda93:3640:1871271599267584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784584241.091550:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584241.091575:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599267840 00000100:00100000:1.0:1784584241.091579:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599267840 00010000:00010000:1.0:1784584241.091593:0:22732:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b303b1c200/0xdab2421a42e494db lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e494d4 expref: 24 pid: 22740 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584241.091605:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599267584 00000100:00100000:1.0:1784584241.091607:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599267584 00010000:00010000:1.0:1784584241.091616:0:22732:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b43ea7aa00/0xdab2421a42e4951a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e49513 expref: 25 pid: 22740 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584241.091826:0:22731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599267712 00000100:00100000:3.0:1784584241.091855:0:22731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784584241.091867:0:22731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b436ec1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:954867da-9a7c-4a17-b608-74c1de1cda93+3:25777:x1871271599267712:12345-0@lo:104: 00010000:00010000:3.0:1784584241.091877:0:22731:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a000/0xdab2421a42e494c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e494cd expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584241.091916:0:22731:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784584241.091921:0:22731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b436ec1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:954867da-9a7c-4a17-b608-74c1de1cda93+3:25777:x1871271599267712:12345-0@lo:104: Request processed in 56us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584241.091927:0:22731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784584241.091954:0:25777:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b43cba1180 going to sleep for 11 seconds 00010000:00010000:3.0:1784584241.091970:0:25777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b418982c00/0xdab2421a42e495b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e495ad expref: 25 pid: 22740 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584241.091981:0:25777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bc0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25777:1871271599267072:0@lo:104: 00000100:00100000:3.0:1784584241.091991:0:25777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b436ec0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25777:1871271599267200:0@lo:104: 00000100:00100000:3.0:1784584241.091998:0:25777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b436ec2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25777:1871271599267328:0@lo:104: 00000100:00100000:3.0:1784584241.092004:0:25777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b436ec3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25777:1871271599267712:0@lo:104: 00000100:00100000:1.0:1784584241.093681:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784584241.093702:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303853480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:954867da-9a7c-4a17-b608-74c1de1cda93+24:3640:x1871271599267840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784584241.093720:0:22732:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584241.093728:0:22732:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b303b1c200/0xdab2421a42e494db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e494d4 expref: 24 pid: 22740 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584241.093740:0:22732:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b303b1c200/0xdab2421a42e494db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e494d4 expref: 24 pid: 22740 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584241.093757:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b303b1c200/0xdab2421a42e494db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e494d4 expref: 24 pid: 22740 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584241.093773:0:22732:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584241.093846:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303853480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:954867da-9a7c-4a17-b608-74c1de1cda93+23:3640:x1871271599267840:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (2405us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584241.093854:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784584241.093883:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784584241.093889:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303852300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:954867da-9a7c-4a17-b608-74c1de1cda93+22:3640:x1871271599267584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784584241.093910:0:22732:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584241.093915:0:22732:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b43ea7aa00/0xdab2421a42e4951a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e49513 expref: 22 pid: 22740 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584241.093922:0:22732:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b43ea7aa00/0xdab2421a42e4951a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e49513 expref: 22 pid: 22740 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584241.093932:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b43ea7aa00/0xdab2421a42e4951a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e49513 expref: 22 pid: 22740 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584241.093941:0:22732:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584241.093965:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303852300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:954867da-9a7c-4a17-b608-74c1de1cda93+21:3640:x1871271599267584:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (2414us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584241.093971:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784584241.094107:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:954867da-9a7c-4a17-b608-74c1de1cda93:3640:1871271599267584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584241.094116:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:954867da-9a7c-4a17-b608-74c1de1cda93:3640:1871271599267840:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784584241.094337:0:25088:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784584241.094345:0:25088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a000/0xdab2421a42e494c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdab2421a42e494cd expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584241.094353:0:25088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ea7a000 already unused, calling callback (ffffffffc1439c20) 10000000:00010000:0.0:1784584241.094356:0:25088:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a000/0xdab2421a42e494c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdab2421a42e494cd expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584241.094366:0:25088:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a000/0xdab2421a42e494c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdab2421a42e494cd expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784584241.094373:0:25088:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a000/0xdab2421a42e494c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdab2421a42e494cd expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584241.094379:0:25088:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784584241.094419:0:25088:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a000/0xdab2421a42e494c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e494cd expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584241.094426:0:25088:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784584241.094445:0:25088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a000/0xdab2421a42e494c6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e494cd expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584241.094452:0:25088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff98b43ea7a000/0xdab2421a42e494c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdab2421a42e494cd expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584241.094464:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584241.094488:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584241.094499:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584241.094512:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:954867da-9a7c-4a17-b608-74c1de1cda93:3641:1871271599267968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784584241.094549:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584241.094590:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599267968 00000100:00100000:0.0:1784584241.094596:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599267968 00010000:00010000:0.0:1784584241.094616:0:22732:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b4332b8a00/0xdab2421a42e494cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e494c6 expref: 21 pid: 22741 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584241.094641:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784584241.094647:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404954700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:954867da-9a7c-4a17-b608-74c1de1cda93+21:3641:x1871271599267968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784584241.094654:0:22732:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584241.094658:0:22732:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b4332b8a00/0xdab2421a42e494cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdab2421a42e494c6 expref: 21 pid: 22741 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584241.094666:0:22732:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b4332b8a00/0xdab2421a42e494cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdab2421a42e494c6 expref: 21 pid: 22741 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584241.094676:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b4332b8a00/0xdab2421a42e494cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdab2421a42e494c6 expref: 21 pid: 22741 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584241.094685:0:22732:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584241.094708:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404954700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:954867da-9a7c-4a17-b608-74c1de1cda93+20:3641:x1871271599267968:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584241.094714:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784584241.094739:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:954867da-9a7c-4a17-b608-74c1de1cda93:3641:1871271599267968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784584241.097742:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584241.097791:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584241.097818:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580294912 00000100:00100000:0.0:1784584241.097827:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580294912 00010000:00010000:0.0:1784584241.097880:0:22732:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b303b1c400/0xdab2421a42e49800 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee859 expref: 13 pid: 22741 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584241.097910:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580295040 00000100:00100000:0.0:1784584241.097913:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580295040 00010000:00010000:0.0:1784584241.097925:0:22732:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98b4332b9800/0xdab2421a42e4983f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee8c9 expref: 14 pid: 22742 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584241.097940:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 13 00000100:00100000:0.0:1784584241.097948:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30429e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42c9664f-6d9c-42f4-930b-fd8093c44492+14:2401:x1871271580294912:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784584241.097961:0:22732:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584241.097967:0:22732:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b303b1c400/0xdab2421a42e49800 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee859 expref: 14 pid: 22741 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584241.097977:0:22732:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b303b1c400/0xdab2421a42e49800 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee859 expref: 14 pid: 22741 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584241.097996:0:22732:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584241.098043:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30429e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42c9664f-6d9c-42f4-930b-fd8093c44492+14:2401:x1871271580294912:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 95us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584241.098050:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 13 00000100:00100000:0.0:1784584241.098092:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 14 00000100:00100000:0.0:1784584241.098098:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404957800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42c9664f-6d9c-42f4-930b-fd8093c44492+13:2401:x1871271580295040:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784584241.098106:0:22732:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584241.098110:0:22732:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98b4332b9800/0xdab2421a42e4983f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee8c9 expref: 13 pid: 22742 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584241.098119:0:22732:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98b4332b9800/0xdab2421a42e4983f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee8c9 expref: 13 pid: 22742 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584241.098138:0:22732:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98b43ebd9a00/0xdab2421a42e49870 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584241.098146:0:22732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b43ebd9a00/0xdab2421a42e49870 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584241.098160:0:22732:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b43ebd9a00/0xdab2421a42e49870 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584241.098167:0:22732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98b43ebd9a00/0xdab2421a42e49870 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584241.098173:0:22732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98b43ebd9a00/0xdab2421a42e49870 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584241.098178:0:22732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98b43ebd9a00/0xdab2421a42e49870 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584241.098184:0:22732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9a00 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:0.0:1784584241.098188:0:22732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98b43ebd9a00/0xdab2421a42e49870 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584241.098195:0:22732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98b43ebd9a00/0xdab2421a42e49870 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584241.098203:0:22732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98b43ebd9a00/0xdab2421a42e49870 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584241.098212:0:22732:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584241.098231:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404957800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42c9664f-6d9c-42f4-930b-fd8093c44492+13:2401:x1871271580295040:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 132us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584241.098245:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 14 00010000:00010000:3.0:1784584241.098452:0:25777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b4332b9800/0xdab2421a42e4983f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee8c9 expref: 12 pid: 22742 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584241.098495:0:25777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bc2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25777:1871271599266816:192.168.203.51@tcp:104: 00010000:00010000:3.0:1784584241.098508:0:25777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b303b1c400/0xdab2421a42e49800 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee859 expref: 11 pid: 22741 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584241.098518:0:25777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bc2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25777:1871271599266944:192.168.203.51@tcp:104: 00010000:00010000:3.0:1784584241.098601:0:25777:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98b43ebd9a00/0xdab2421a42e49870 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584241.098610:0:25777:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98b43ebd9a00/0xdab2421a42e49870 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584241.098615:0:25777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98b43ebd9a00/0xdab2421a42e49870 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584241.098621:0:25777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98b43ebd9a00/0xdab2421a42e49870 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584241.136272:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584242.157688:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584242.216733:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584242.216830:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580295168 00000100:00100000:3.0:1784584242.216839:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580295168 00000100:00100000:3.0:1784584242.216913:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 23 00000100:00100000:3.0:1784584242.216925:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+6:18713:x1871271580295168:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784584242.216942:0:23817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584242.216960:0:23817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e49877 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee901 expref: -99 pid: 23817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784584242.216976:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784584242.217015:0:23817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e4987e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.217029:0:23817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e4987e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.217040:0:23817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e4987e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.217053:0:23817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e49885 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.217072:0:23817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e49885 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.217079:0:23817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e49885 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.217149:0:23817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e4988c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.217157:0:23817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e4988c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.217164:0:23817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e4988c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584242.217190:0:23817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784584242.217193:0:23817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784584242.217223:0:23817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e4988c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.217233:0:23817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e4987e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.217239:0:23817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e4987e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.217246:0:23817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e4987e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.217252:0:23817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9e00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784584242.217255:0:23817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e4987e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.217267:0:23817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e4987e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.217291:0:23817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b43e8ab600) 00010000:00010000:3.0:1784584242.217294:0:23817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584242.217298:0:23817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e4987e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.217304:0:23817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e4987e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.217316:0:23817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e49885 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.217323:0:23817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e49885 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.217328:0:23817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e49885 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.217333:0:23817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8c00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784584242.217336:0:23817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e49885 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.217341:0:23817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e49885 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.217348:0:23817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff98b43e8abd00) 00010000:00010000:3.0:1784584242.217350:0:23817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584242.217352:0:23817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e49885 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.217366:0:23817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e49885 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.217393:0:23817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e49877 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee901 expref: 8 pid: 23817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.217404:0:23817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8e00/0xdab2421a42e4988c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee901 expref: 7 pid: 23817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.217422:0:23817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98b43e8ab400) 00010000:00010000:3.0:1784584242.217424:0:23817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784584242.217427:0:23817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd8e00, rc 0) 00000100:00100000:3.0:1784584242.217529:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+7:18713:x1871271580295168:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 606us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584242.217536:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 23 00000100:00100000:0.0:1784584242.222313:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584242.222391:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580295296 00000100:00100000:3.0:1784584242.222401:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580295296 00000100:00100000:1.0:1784584242.222505:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 5 00000100:00100000:1.0:1784584242.222520:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+7:18713:x1871271580295296:12345-192.168.203.51@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1784584242.222615:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+7:18713:x1871271580295296:12345-192.168.203.51@tcp:900:lhsmtool_posix.0 Request processed in 101us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584242.222624:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 5 00000100:00100000:0.0:1784584242.228055:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584242.228330:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580295552 00000100:00100000:3.0:1784584242.228342:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580295552 00000100:00100000:3.0:1784584242.228430:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 24 00000100:00100000:3.0:1784584242.228441:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+7:18713:x1871271580295552:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784584242.228496:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584242.228522:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e49893 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee908 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.228946:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e4989a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.228974:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e4989a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.228986:0:22747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e4989a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.229036:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e498a1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.229044:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e498a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.229051:0:22747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e498a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.229164:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e498a8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.229173:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e498a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.229181:0:22747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e498a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584242.229191:0:22747:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1784584242.229354:0:22747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e4989a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.229362:0:22747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e4989a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.229369:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e4989a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.229381:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8c00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784584242.229385:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e4989a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.229392:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e4989a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.229404:0:22747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98b43e8ab400) 00010000:00010000:3.0:1784584242.229930:0:22747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584242.229938:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e4989a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.229945:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e4989a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.229959:0:22747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e498a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.229964:0:22747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e498a1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.229969:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e498a1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.229974:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9e00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784584242.229976:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e498a1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.229981:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e498a1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.230001:0:22747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98b43e8abd00) 00010000:00010000:3.0:1784584242.230004:0:22747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584242.230006:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e498a1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.230012:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e498a1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.232406:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e49893 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee908 expref: 10 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.232447:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9400/0xdab2421a42e498a8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee908 expref: 9 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.232458:0:22747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98b43e8abb00) 00010000:00010000:3.0:1784584242.232460:0:22747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584242.232464:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd9400, rc 0) 00000100:00100000:2.0:1784584242.233563:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+9:18713:x1871271580295552:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 5116us (5520us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1784584242.233576:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 24 00000100:00100000:0.0:1784584242.237426:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584242.243909:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580295680 00000100:00100000:1.0:1784584242.243922:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580295680 00000100:00100000:1.0:1784584242.244021:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 25 00000100:00100000:1.0:1784584242.244032:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+9:18713:x1871271580295680:12345-192.168.203.51@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1784584242.244150:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+9:18713:x1871271580295680:12345-192.168.203.51@tcp:59:lhsmtool_posix.0 Request processed in 120us (6744us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584242.244159:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 25 00000100:00100000:0.0:1784584242.251728:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584242.252861:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580295808 00000100:00100000:3.0:1784584242.252874:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580295808 00000100:00100000:3.0:1784584242.252955:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 26 00000100:00100000:3.0:1784584242.252966:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+5:18713:x1871271580295808:12345-192.168.203.51@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1784584242.257596:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1784584242.260061:0:22748:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 7050us 00000100:00100000:0.0:1784584242.292769:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+5:18713:x1871271580295808:12345-192.168.203.51@tcp:59:lhsmtool_posix.0 Request processed in 39793us (41038us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584242.292783:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 26 00000100:00100000:2.0:1784584242.322764:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584242.322852:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580295936 00000100:00100000:3.0:1784584242.322863:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580295936 00000100:00100000:3.0:1784584242.322926:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 27 00000100:00100000:3.0:1784584242.322937:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+9:18720:x1871271580295936:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1784584242.322973:0:23817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584242.322994:0:23817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e498b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee90f expref: -99 pid: 23817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.323066:0:23817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e498bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.323081:0:23817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e498bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.323109:0:23817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e498bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.323125:0:23817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e498c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.323132:0:23817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e498c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.323138:0:23817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e498c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.323178:0:23817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e498bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.323185:0:23817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e498bd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.323191:0:23817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e498bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.323197:0:23817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9e00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784584242.323207:0:23817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e498bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.323215:0:23817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e498bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.323228:0:23817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b43e8ab600) 00010000:00010000:3.0:1784584242.323231:0:23817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584242.323234:0:23817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e498bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.323241:0:23817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e498bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.323252:0:23817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e498c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.323258:0:23817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e498c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.323264:0:23817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e498c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.323269:0:23817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8c00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784584242.323283:0:23817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e498c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.323290:0:23817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e498c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.323298:0:23817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff98b43e8abd00) 00010000:00010000:3.0:1784584242.323300:0:23817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584242.323310:0:23817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e498c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.323316:0:23817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e498c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.323350:0:23817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e498b6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee90f expref: 10 pid: 23817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.323365:0:23817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b43e8ab600) 00010000:00010000:3.0:1784584242.323368:0:23817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584242.323372:0:23817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e498b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee90f expref: 10 pid: 23817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.323381:0:23817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd9a00, rc 0) 00000100:00100000:3.0:1784584242.323452:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+9:18720:x1871271580295936:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 516us (697us total) trans 0 rc 301/301 00000100:00100000:3.0:1784584242.323463:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 27 00000100:00100000:3.0:1784584242.331723:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584242.334523:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580296064 00000100:00100000:2.0:1784584242.334540:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580296064 00000100:00100000:2.0:1784584242.334724:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:2.0:1784584242.334736:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b436ec3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+9:18720:x1871271580296064:12345-192.168.203.51@tcp:700:lfs.0 00000100:00100000:2.0:1784584242.335410:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b436ec3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+9:18720:x1871271580296064:12345-192.168.203.51@tcp:700:lfs.0 Request processed in 673us (3692us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584242.335419:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:0.0:1784584242.338994:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584242.339186:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580296320 00000100:00100000:1.0:1784584242.339197:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580296320 00000100:00100000:1.0:1784584242.339293:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 28 00000100:00100000:1.0:1784584242.339305:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+9:18720:x1871271580296320:12345-192.168.203.51@tcp:36:lfs.0 00010000:00010000:1.0:1784584242.339447:0:22749:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584242.339554:0:22749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9c00/0xdab2421a42e4982a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee88a expref: 9 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.339574:0:22749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b43e8ab600) 00010000:00010000:1.0:1784584242.339579:0:22749:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784584242.339657:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e498cb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.339673:0:22749:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e49869 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee8fa expref: 5 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.339682:0:22749:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e498cb lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.339715:0:22749:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e49869 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee8fa expref: 5 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.339730:0:22749:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e49869 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee8fa expref: 5 pid: 22748 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584242.339745:0:22749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303852a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22749:1871271599268096:192.168.203.51@tcp:104: 00000100:00100000:1.0:1784584242.339832:0:22749:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b430b186c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584242.346625:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584242.346841:0:22749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303852a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22749:1871271599268096:192.168.203.51@tcp:104: 00010000:00010000:1.0:1784584242.346885:0:22749:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e498cb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584242.346967:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580296448 00000100:00100000:0.0:1784584242.346975:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580296448 00010000:00010000:0.0:1784584242.347021:0:22732:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e49869 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee8fa expref: 6 pid: 22748 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784584242.347124:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784584242.347261:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 15 00000100:00100000:0.0:1784584242.347281:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b436ec2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4582ced1-2e60-4215-b04a-25e91daf3166+6:2401:x1871271580296448:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784584242.347296:0:22732:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584242.347303:0:22732:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e49869 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee8fa expref: 6 pid: 22748 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.347316:0:22732:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e49869 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee8fa expref: 6 pid: 22748 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.347336:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1800/0xdab2421a42e49869 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee8fa expref: 6 pid: 22748 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.347360:0:22732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b43e8ab600) 00010000:00010000:0.0:1784584242.347365:0:22732:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e498cb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.347374:0:22732:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e498cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.347381:0:22732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e498cb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.347410:0:22732:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584242.347499:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b436ec2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4582ced1-2e60-4215-b04a-25e91daf3166+5:2401:x1871271580296448:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 197us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584242.347508:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 15 00010000:00010000:3.0:1784584242.347944:0:22749:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e498cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.347954:0:22749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e498cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.347978:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e498d2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.347988:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e498d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.348005:0:22749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e498d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.351035:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e498d9 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.351057:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e498d9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.351069:0:22749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e498d9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784584242.351197:0:22749:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000db063a50 reply state 000000004b2ffc29 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e498d9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.351209:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e498d9 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.351217:0:22749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98b43e8abf00) 00010000:00010000:3.0:1784584242.351220:0:22749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784584242.351224:0:22749:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784584242.351231:0:22749:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1784584242.351239:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e498cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.351247:0:22749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e498cb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.351254:0:22749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e498cb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.351259:0:22749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1c200 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784584242.351282:0:22749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e498cb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.351291:0:22749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e498cb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.351304:0:22749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b43e8ab600) 00010000:00010000:3.0:1784584242.351307:0:22749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584242.351310:0:22749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e498cb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.351317:0:22749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e498cb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784584242.351337:0:22749:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000db063a50 reply state 000000004b2ffc29 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e498d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.351347:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e498d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.351354:0:22749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff98b43e8abd00) 00010000:00010000:3.0:1784584242.351356:0:22749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784584242.351358:0:22749:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1784584242.351513:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+10:18720:x1871271580296320:12345-192.168.203.51@tcp:36:lfs.0 Request processed in 12167us (12486us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1784584242.351521:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 28 00000100:00100000:3.0:1784584242.453901:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584242.454003:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580296576 00000100:00100000:1.0:1784584242.454013:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580296576 00000100:00100000:1.0:1784584242.454073:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 147 00000100:00100000:1.0:1784584242.454083:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42c9664f-6d9c-42f4-930b-fd8093c44492+11:18094:x1871271580296576:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784584242.454101:0:22741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584242.454121:0:22741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b303b1c800/0xdab2421a42e498e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee916 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.454148:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b303b1c800/0xdab2421a42e498e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee916 expref: 12 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.454160:0:22741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b303b1c800/0xdab2421a42e498e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee916 expref: 12 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.454169:0:22741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b303b1c800, rc 0) 00000100:00100000:1.0:1784584242.454345:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42c9664f-6d9c-42f4-930b-fd8093c44492+12:18094:x1871271580296576:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 Request processed in 262us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584242.454353:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 147 00000100:00100000:2.0:1784584242.460573:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584242.460730:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580296704 00000100:00100000:0.0:1784584242.460745:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580296704 00000100:00100000:0.0:1784584242.460796:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 148 00000100:00100000:0.0:1784584242.460804:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42c9664f-6d9c-42f4-930b-fd8093c44492+12:18094:x1871271580296704:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784584242.461166:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42c9664f-6d9c-42f4-930b-fd8093c44492+12:18094:x1871271580296704:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 Request processed in 361us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584242.461175:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 148 00000100:00100000:2.0:1784584242.461730:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584242.461910:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580296832 00000100:00100000:3.0:1784584242.461915:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580296832 00000100:00100000:3.0:1784584242.461995:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 29 00000100:00100000:3.0:1784584242.462004:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+10:18728:x1871271580296832:12345-192.168.203.51@tcp:101:lctl.0 00010000:00010000:3.0:1784584242.462033:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584242.462054:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e498e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee91d expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584242.462381:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00010000:00010000:3.0:1784584242.462905:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e498ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.462921:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e498ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.462933:0:22747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e498ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584242.462976:0:22747:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784584242.462980:0:22747:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784584242.463012:0:22747:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e498ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.463037:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e498e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee91d expref: 12 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.463053:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9e00/0xdab2421a42e498ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee91d expref: 11 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.463062:0:22747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b43e8ab600) 00010000:00010000:3.0:1784584242.463065:0:22747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784584242.463068:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd9e00, rc 0) 00000100:00100000:3.0:1784584242.463213:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+11:18728:x1871271580296832:12345-192.168.203.51@tcp:101:lctl.0 Request processed in 1210us (1483us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584242.463221:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 29 00000100:00100000:1.0:1784584242.463299:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580296960 00000100:00100000:1.0:1784584242.463305:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580296960 00000100:00100000:1.0:1784584242.463339:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 149 00000100:00100000:1.0:1784584242.463346:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42c9664f-6d9c-42f4-930b-fd8093c44492+12:18094:x1871271580296960:12345-192.168.203.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784584242.463827:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42c9664f-6d9c-42f4-930b-fd8093c44492+12:18094:x1871271580296960:12345-192.168.203.51@tcp:503:ll_cfg_requeue.0 Request processed in 479us (1444us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584242.463851:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 149 00000100:00100000:2.0:1784584242.473157:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584242.473242:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580297088 00000100:00100000:0.0:1784584242.473252:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580297088 00000100:00100000:0.0:1784584242.473359:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 150 00000100:00100000:0.0:1784584242.473370:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42c9664f-6d9c-42f4-930b-fd8093c44492+12:18094:x1871271580297088:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584242.473386:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584242.473412:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b4332b9800/0xdab2421a42e498f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee924 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.473441:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4332b9800/0xdab2421a42e498f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee924 expref: 13 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.473452:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b4332b9800/0xdab2421a42e498f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee924 expref: 13 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.473461:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b9800, rc 0) 00000100:00100000:0.0:1784584242.473546:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42c9664f-6d9c-42f4-930b-fd8093c44492+13:18094:x1871271580297088:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 Request processed in 178us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584242.473553:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 150 00000100:00100000:2.0:1784584242.475221:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584242.475303:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580297216 00000100:00100000:1.0:1784584242.475311:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580297216 00000100:00100000:1.0:1784584242.475363:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 151 00000100:00100000:1.0:1784584242.475371:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42c9664f-6d9c-42f4-930b-fd8093c44492+13:18094:x1871271580297216:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784584242.475530:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42c9664f-6d9c-42f4-930b-fd8093c44492+13:18094:x1871271580297216:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 Request processed in 158us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584242.475539:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 151 00000100:00100000:3.0:1784584242.478045:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584242.478234:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580297344 00000100:00100000:0.0:1784584242.478244:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580297344 00000100:00100000:0.0:1784584242.478300:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 152 00000100:00100000:0.0:1784584242.478308:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42c9664f-6d9c-42f4-930b-fd8093c44492+13:18094:x1871271580297344:12345-192.168.203.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784584242.478635:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42c9664f-6d9c-42f4-930b-fd8093c44492+13:18094:x1871271580297344:12345-192.168.203.51@tcp:503:ll_cfg_requeue.0 Request processed in 325us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584242.478642:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 152 00000100:00100000:2.0:1784584242.483881:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584242.484047:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580297472 00000100:00100000:0.0:1784584242.484054:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580297472 00000100:00100000:0.0:1784584242.484141:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 30 00000100:00100000:0.0:1784584242.484152:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4582ced1-2e60-4215-b04a-25e91daf3166+5:18730:x1871271580297472:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1784584242.484177:0:22748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584242.484197:0:22748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9600/0xdab2421a42e498fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee92b expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.484286:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e49903 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.484300:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e49903 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.484310:0:22748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e49903 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584242.484430:0:22748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784584242.484434:0:22748:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784584242.484457:0:22748:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e49903 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.484559:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9600/0xdab2421a42e498fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee92b expref: 7 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.484576:0:22748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9000/0xdab2421a42e49903 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee92b expref: 6 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.484582:0:22748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b43e8ab600) 00010000:00010000:0.0:1784584242.484584:0:22748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784584242.484586:0:22748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b9000, rc 0) 00000100:00100000:0.0:1784584242.484645:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4582ced1-2e60-4215-b04a-25e91daf3166+6:18730:x1871271580297472:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 495us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584242.484652:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 30 00000100:00100000:2.0:1784584242.489777:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584242.489929:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580297600 00000100:00100000:0.0:1784584242.489939:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580297600 00000100:00100000:0.0:1784584242.490049:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 31 00000100:00100000:0.0:1784584242.490060:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4582ced1-2e60-4215-b04a-25e91daf3166+6:18730:x1871271580297600:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1784584242.490080:0:23817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584242.490115:0:23817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9200/0xdab2421a42e4990a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee932 expref: -99 pid: 23817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.490175:0:23817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e49911 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.490188:0:23817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e49911 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.490199:0:23817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e49911 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.490207:0:23817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49918 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.490212:0:23817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49918 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.490216:0:23817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49918 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.490287:0:23817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8600/0xdab2421a42e4991f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.490292:0:23817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8600/0xdab2421a42e4991f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.490296:0:23817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8600/0xdab2421a42e4991f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584242.490335:0:23817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784584242.490338:0:23817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784584242.490355:0:23817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8600/0xdab2421a42e4991f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.490368:0:23817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e49911 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.490374:0:23817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e49911 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.490380:0:23817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e49911 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.490386:0:23817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4332b8e00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784584242.490390:0:23817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e49911 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.490398:0:23817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e49911 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.490536:0:23817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b43e8ab600) 00010000:00010000:0.0:1784584242.490540:0:23817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584242.490545:0:23817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e49911 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.490551:0:23817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e49911 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.490564:0:23817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49918 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.490579:0:23817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49918 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.490585:0:23817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49918 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.490589:0:23817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4332b8a00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784584242.490592:0:23817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49918 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.490599:0:23817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49918 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.490607:0:23817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff98b43e8abd00) 00010000:00010000:0.0:1784584242.490609:0:23817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584242.490612:0:23817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49918 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.490667:0:23817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49918 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.490694:0:23817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9200/0xdab2421a42e4990a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee932 expref: 8 pid: 23817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.490707:0:23817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8600/0xdab2421a42e4991f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee932 expref: 7 pid: 23817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.490712:0:23817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98b43e8abf00) 00010000:00010000:0.0:1784584242.490714:0:23817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784584242.490720:0:23817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b8600, rc 0) 00000100:00100000:0.0:1784584242.490850:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4582ced1-2e60-4215-b04a-25e91daf3166+7:18730:x1871271580297600:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 792us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584242.490857:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 31 00000100:00100000:3.0:1784584242.492612:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584242.493013:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580297728 00000100:00100000:0.0:1784584242.493021:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580297728 00000100:00100000:0.0:1784584242.493130:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00100000:0.0:1784584242.493138:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b436ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4582ced1-2e60-4215-b04a-25e91daf3166+5:18730:x1871271580297728:12345-192.168.203.51@tcp:900:lfs.0 00000100:00100000:0.0:1784584242.493205:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b436ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4582ced1-2e60-4215-b04a-25e91daf3166+5:18730:x1871271580297728:12345-192.168.203.51@tcp:900:lfs.0 Request processed in 68us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584242.493213:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00080000:2.0:1784584242.495223:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784584242.496658:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584242.496737:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580297984 00000100:00100000:3.0:1784584242.496748:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580297984 00000100:00100000:3.0:1784584242.496812:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 32 00000100:00100000:3.0:1784584242.496822:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4582ced1-2e60-4215-b04a-25e91daf3166+7:18730:x1871271580297984:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1784584242.496840:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584242.496859:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49926 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee939 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584242.497288:0:22749:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1784584242.497870:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49926 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee939 expref: 9 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.497885:0:22749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b43e8ab600) 00010000:00010000:3.0:1784584242.497889:0:22749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784584242.497894:0:22749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49926 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee939 expref: 9 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.497908:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd8000, rc 0) 00000100:00100000:3.0:1784584242.497982:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4582ced1-2e60-4215-b04a-25e91daf3166+8:18730:x1871271580297984:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 1162us (1331us total) trans 12884901891 rc 301/301 00000100:00100000:3.0:1784584242.497989:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 32 00000100:00100000:3.0:1784584242.500581:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584242.500671:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580298240 00000100:00100000:2.0:1784584242.500695:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580298240 00000100:00100000:2.0:1784584242.500751:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 33 00000100:00100000:2.0:1784584242.500760:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b436ec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4582ced1-2e60-4215-b04a-25e91daf3166+8:18730:x1871271580298240:12345-192.168.203.51@tcp:36:lfs.0 00010000:00010000:2.0:1784584242.500823:0:22747:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584242.500848:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8600/0xdab2421a42e4991f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee932 expref: 8 pid: 23817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584242.500866:0:22747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98b43e8abf00) 00010000:00010000:2.0:1784584242.500870:0:22747:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784584242.500891:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e49934 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584242.500903:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e49934 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584242.500911:0:22747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e49934 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784584242.501244:0:22747:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000087f2ac41 reply state 00000000b6508f46 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e49934 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584242.501258:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e49934 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584242.501263:0:22747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98b43e8abf00) 00010000:00010000:2.0:1784584242.501265:0:22747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1784584242.501266:0:22747:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784584242.501283:0:22747:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1784584242.501386:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b436ec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4582ced1-2e60-4215-b04a-25e91daf3166+9:18730:x1871271580298240:12345-192.168.203.51@tcp:36:lfs.0 Request processed in 626us (811us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1784584242.501395:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 33 00000100:00100000:2.0:1784584242.503728:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584242.503932:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580298496 00000100:00100000:3.0:1784584242.504006:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580298496 00000100:00100000:3.0:1784584242.504060:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 2 00000100:00100000:3.0:1784584242.504070:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4582ced1-2e60-4215-b04a-25e91daf3166+9:18730:x1871271580298496:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:3.0:1784584242.504423:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4582ced1-2e60-4215-b04a-25e91daf3166+10:18730:x1871271580298496:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 353us (701us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1784584242.504431:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 2 00000100:00100000:3.0:1784584242.506593:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584242.506749:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580298752 00000100:00100000:0.0:1784584242.506759:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580298752 00000100:00100000:0.0:1784584242.506914:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 34 00000100:00100000:0.0:1784584242.506926:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b436ec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4582ced1-2e60-4215-b04a-25e91daf3166+10:18730:x1871271580298752:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1784584242.506949:0:22748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584242.507067:0:22748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9200/0xdab2421a42e4993b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee940 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.507661:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49942 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.507678:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49942 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.507689:0:22748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49942 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.507700:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e49949 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.507722:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e49949 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.507728:0:22748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e49949 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584242.507835:0:22748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1784584242.507910:0:22748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49942 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.507919:0:22748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49942 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.507925:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49942 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.507931:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4332b8a00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784584242.507936:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49942 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.507944:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49942 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.507967:0:22748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b43e8ab600) 00010000:00010000:0.0:1784584242.507971:0:22748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584242.507975:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49942 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.508172:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49942 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.508200:0:22748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e49949 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.508207:0:22748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e49949 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.508213:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e49949 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.508218:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4332b8e00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784584242.508222:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e49949 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.508227:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e49949 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.508236:0:22748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff98b43e8abd00) 00010000:00010000:0.0:1784584242.508238:0:22748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584242.508241:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e49949 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.508246:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e49949 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.508295:0:22748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9200/0xdab2421a42e4993b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee940 expref: 12 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.508306:0:22748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b43e8ab600) 00010000:00010000:0.0:1784584242.508309:0:22748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784584242.508319:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9200/0xdab2421a42e4993b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee940 expref: 12 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.508329:0:22748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b9200, rc 0) 00000100:00100000:0.0:1784584242.508402:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b436ec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4582ced1-2e60-4215-b04a-25e91daf3166+11:18730:x1871271580298752:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 1478us (1815us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1784584242.508419:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 34 00000100:00100000:2.0:1784584242.515382:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584242.515507:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580298880 00000100:00100000:0.0:1784584242.515517:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580298880 00000100:00100000:0.0:1784584242.515572:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 35 00000100:00100000:0.0:1784584242.515581:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4582ced1-2e60-4215-b04a-25e91daf3166+11:18730:x1871271580298880:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1784584242.515616:0:23817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584242.515638:0:23817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9200/0xdab2421a42e49957 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee947 expref: -99 pid: 23817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.515726:0:23817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4995e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.515740:0:23817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4995e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.515786:0:23817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4995e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584242.517076:0:23817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784584242.517094:0:23817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784584242.517230:0:23817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4995e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.517316:0:23817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9200/0xdab2421a42e49957 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee947 expref: 13 pid: 23817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.517373:0:23817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4995e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee947 expref: 12 pid: 23817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.517383:0:23817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98b43e8abf00) 00010000:00010000:0.0:1784584242.517386:0:23817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784584242.517702:0:23817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b8e00, rc 0) 00000100:00100000:0.0:1784584242.517826:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4582ced1-2e60-4215-b04a-25e91daf3166+12:18730:x1871271580298880:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 2240us (2448us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584242.517879:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 35 00000100:00100000:2.0:1784584242.521049:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584242.521097:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580299008 00000100:00100000:1.0:1784584242.521107:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580299008 00000100:00100000:3.0:1784584242.521307:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 3 00000100:00100000:3.0:1784584242.521319:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4582ced1-2e60-4215-b04a-25e91daf3166+12:18730:x1871271580299008:12345-192.168.203.51@tcp:37:lfs.0 00000100:00100000:2.0:1784584242.524850:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4582ced1-2e60-4215-b04a-25e91daf3166+12:18730:x1871271580299008:12345-192.168.203.51@tcp:37:lfs.0 Request processed in 3522us (3796us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584242.524866:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 3 00000100:00100000:2.0:1784584242.532457:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584242.532588:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580299264 00000100:00100000:1.0:1784584242.532599:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580299264 00000100:00100000:1.0:1784584242.532661:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 4 00000100:00100000:1.0:1784584242.532671:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b406067850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4582ced1-2e60-4215-b04a-25e91daf3166+12:18730:x1871271580299264:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:1.0:1784584242.533422:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b406067850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4582ced1-2e60-4215-b04a-25e91daf3166+13:18730:x1871271580299264:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 749us (970us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1784584242.533432:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 4 00000100:00100000:3.0:1784584242.582981:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584242.588214:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580299392 00000100:00100000:1.0:1784584242.588228:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580299392 00000100:00100000:1.0:1784584242.588312:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 36 00000100:00100000:1.0:1784584242.588322:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b436ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+11:18737:x1871271580299392:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:1.0:1784584242.588342:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584242.588365:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e49965 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee94e expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.588852:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c400/0xdab2421a42e4996c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.588867:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c400/0xdab2421a42e4996c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.588878:0:22749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c400/0xdab2421a42e4996c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.588888:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c000/0xdab2421a42e49973 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.588895:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c000/0xdab2421a42e49973 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.588901:0:22749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c000/0xdab2421a42e49973 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.589151:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f195a00/0xdab2421a42e4997a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.589161:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f195a00/0xdab2421a42e4997a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.589168:0:22749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f195a00/0xdab2421a42e4997a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584242.589200:0:22749:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784584242.589203:0:22749:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784584242.589236:0:22749:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f195a00/0xdab2421a42e4997a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.589259:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c400/0xdab2421a42e4996c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.589265:0:22749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c400/0xdab2421a42e4996c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.589281:0:22749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c400/0xdab2421a42e4996c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.589287:0:22749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1c400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784584242.589292:0:22749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c400/0xdab2421a42e4996c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.589300:0:22749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c400/0xdab2421a42e4996c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.589312:0:22749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b43e8ab600) 00010000:00010000:1.0:1784584242.589315:0:22749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584242.589319:0:22749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c400/0xdab2421a42e4996c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.589326:0:22749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c400/0xdab2421a42e4996c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.589338:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c000/0xdab2421a42e49973 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.589345:0:22749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c000/0xdab2421a42e49973 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.589350:0:22749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c000/0xdab2421a42e49973 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.589361:0:22749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b303b1c000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784584242.589364:0:22749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c000/0xdab2421a42e49973 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.589370:0:22749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c000/0xdab2421a42e49973 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.589377:0:22749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff98b43e8abd00) 00010000:00010000:1.0:1784584242.589379:0:22749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584242.589381:0:22749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c000/0xdab2421a42e49973 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.589387:0:22749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c000/0xdab2421a42e49973 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.589412:0:22749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b303b1c200/0xdab2421a42e49965 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee94e expref: 13 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.589424:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f195a00/0xdab2421a42e4997a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee94e expref: 12 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.589431:0:22749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98b43e8abf00) 00010000:00010000:1.0:1784584242.589433:0:22749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784584242.589436:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b42f195a00, rc 0) 00000100:00100000:1.0:1784584242.589632:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b436ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+12:18737:x1871271580299392:12345-192.168.203.51@tcp:101:bash.0 Request processed in 1310us (6659us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584242.589641:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 36 00000100:00100000:3.0:1784584242.594442:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584242.594633:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580299520 00000100:00100000:0.0:1784584242.594642:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580299520 00000100:00100000:0.0:1784584242.594700:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:0.0:1784584242.594710:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b436ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+5:18737:x1871271580299520:12345-192.168.203.51@tcp:900:bash.0 00000100:00100000:0.0:1784584242.594793:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b436ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+5:18737:x1871271580299520:12345-192.168.203.51@tcp:900:bash.0 Request processed in 84us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584242.594801:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:2.0:1784584242.600235:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584242.600495:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580299776 00000100:00100000:3.0:1784584242.600505:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580299776 00000100:00100000:3.0:1784584242.600562:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 37 00000100:00100000:3.0:1784584242.600572:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+12:18737:x1871271580299776:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:3.0:1784584242.600592:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584242.600611:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e49981 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee955 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.600718:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49988 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.600733:0:22747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4995e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee947 expref: 12 pid: 23817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.600741:0:22747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49988 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.600778:0:22747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4995e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee947 expref: 12 pid: 23817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584242.600811:0:22747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4995e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee947 expref: 12 pid: 23817 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584242.600824:0:22747:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b436ec1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22747:1871271599268224:192.168.203.51@tcp:104: 00000100:00100000:3.0:1784584242.600999:0:22747:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3028620c0 going to sleep for 11 seconds 00000040:00080000:0.0:1784584242.606363:0:22782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1784584242.607736:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584242.607864:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580299904 00000100:00100000:1.0:1784584242.607894:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580299904 00010000:00010000:1.0:1784584242.607938:0:22733:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4995e lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee947 expref: 13 pid: 23817 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584242.607982:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:1.0:1784584242.607993:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b436ec3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4582ced1-2e60-4215-b04a-25e91daf3166+13:2400:x1871271580299904:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784584242.608008:0:22733:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584242.608015:0:22733:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4995e lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee947 expref: 13 pid: 23817 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.608029:0:22733:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4995e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee947 expref: 13 pid: 23817 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.608051:0:22733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98b43e8abf00) 00010000:00010000:1.0:1784584242.608056:0:22733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49988 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.608067:0:22733:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49988 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.608075:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49988 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584242.608094:0:22733:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584242.608150:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b436ec3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4582ced1-2e60-4215-b04a-25e91daf3166+13:2400:x1871271580299904:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 158us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584242.608158:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 16 00010000:00010000:2.0:1784584242.608656:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8e00/0xdab2421a42e4995e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee947 expref: 12 pid: 23817 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584242.608677:0:22747:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b436ec1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22747:1871271599268224:192.168.203.51@tcp:104: 00010000:00010000:2.0:1784584242.608697:0:22747:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49988 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584242.608710:0:22747:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49988 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584242.608716:0:22747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49988 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584242.608791:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4998f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584242.608801:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4998f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584242.608808:0:22747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4998f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584242.610321:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49996 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584242.610339:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49996 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584242.610349:0:22747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49996 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584242.610360:0:22747:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1784584242.610386:0:22747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49988 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584242.610393:0:22747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49988 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584242.610399:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49988 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584242.610405:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784584242.610409:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49988 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584242.610417:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49988 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584242.610427:0:22747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98b43e8abf00) 00010000:00010000:2.0:1784584242.610430:0:22747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584242.610434:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49988 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584242.610454:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49988 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784584242.610494:0:22747:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a31d6f4f reply state 00000000f482398e transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4998f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584242.610506:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4998f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584242.610513:0:22747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff98b422413200) 00010000:00010000:2.0:1784584242.610515:0:22747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784584242.610517:0:22747:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784584242.610553:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8800/0xdab2421a42e49981 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee955 expref: 15 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584242.610567:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49996 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee955 expref: 14 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584242.610575:0:22747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98b422413600) 00010000:00010000:2.0:1784584242.610577:0:22747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1784584242.610579:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c1400, rc 0) 00000100:00100000:2.0:1784584242.610793:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+15:18737:x1871271580299776:12345-192.168.203.51@tcp:101:bash.0 Request processed in 10221us (10564us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1784584242.610802:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 37 00000100:00100000:3.0:1784584242.631261:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584242.631389:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580300032 00000100:00100000:0.0:1784584242.631400:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580300032 00000100:00100000:0.0:1784584242.632769:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 38 00000100:00100000:0.0:1784584242.632790:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b436ec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+15:18737:x1871271580300032:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:0.0:1784584242.632814:0:22748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584242.632833:0:22748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9200/0xdab2421a42e499a4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee95c expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.632920:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e499ab lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.632934:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e499ab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.632945:0:22748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e499ab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584242.632990:0:22748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1784584242.632995:0:22748:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784584242.633017:0:22748:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e499ab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.633027:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e499ab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.633053:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9200/0xdab2421a42e499a4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee95c expref: 17 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.633072:0:22748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e499ab lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee95c expref: 16 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.633080:0:22748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98b422413600) 00010000:00010000:0.0:1784584242.633083:0:22748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784584242.633086:0:22748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b8a00, rc 0) 00000100:00100000:0.0:1784584242.633213:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b436ec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+16:18737:x1871271580300032:12345-192.168.203.51@tcp:101:bash.0 Request processed in 425us (1961us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584242.633221:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 38 00000100:00100000:3.0:1784584242.636895:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584242.636985:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580300288 00000100:00100000:2.0:1784584242.636994:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580300288 00000100:00100000:2.0:1784584242.637080:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 5 00000100:00100000:2.0:1784584242.637090:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b436ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+16:18737:x1871271580300288:12345-192.168.203.51@tcp:35:bash.0 00000001:00080000:2.0:1784584242.637327:0:22750:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901897 00000100:00100000:2.0:1784584242.637650:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b436ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+18:18737:x1871271580300288:12345-192.168.203.51@tcp:35:bash.0 Request processed in 377us (642us total) trans 12884901898 rc 0/0 00000100:00100000:2.0:1784584242.637660:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 5 00000020:00080000:2.0:1784584242.637665:0:22750:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1784584242.741334:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584242.741636:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580300544 00000100:00100000:0.0:1784584242.741646:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580300544 00000100:00100000:0.0:1784584242.741705:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 39 00000100:00100000:0.0:1784584242.741714:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+18:18747:x1871271580300544:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1784584242.741739:0:23817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584242.741759:0:23817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9200/0xdab2421a42e499b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee963 expref: -99 pid: 23817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584242.742137:0:23817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1784584242.742249:0:23817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9200/0xdab2421a42e499b2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee963 expref: 20 pid: 23817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.742266:0:23817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98b43e8ab600) 00010000:00010000:0.0:1784584242.742279:0:23817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784584242.742284:0:23817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9200/0xdab2421a42e499b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee963 expref: 20 pid: 23817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.742300:0:23817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b9200, rc 0) 00000100:00100000:0.0:1784584242.742520:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+19:18747:x1871271580300544:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 697us (1083us total) trans 12884901899 rc 301/301 00000100:00100000:0.0:1784584242.742531:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 39 00000100:00100000:3.0:1784584242.747161:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584242.747240:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580300800 00000100:00100000:1.0:1784584242.747251:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580300800 00000100:00100000:1.0:1784584242.747330:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00100000:1.0:1784584242.747340:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b436ec1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+19:18747:x1871271580300800:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:1.0:1784584242.747627:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b436ec1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+20:18747:x1871271580300800:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 278us (464us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1784584242.747635:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 6 00000040:00080000:1.0:1784584242.798218:0:23502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1784584242.805730:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584242.806084:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580301056 00000100:00100000:0.0:1784584242.806094:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580301056 00000100:00100000:0.0:1784584242.806189:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 40 00000100:00100000:0.0:1784584242.806200:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b436ec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+20:18750:x1871271580301056:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1784584242.806223:0:22748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584242.806242:0:22748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9200/0xdab2421a42e499c0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee96a expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.806365:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9600/0xdab2421a42e499c7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.806380:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9600/0xdab2421a42e499c7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.806390:0:22748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9600/0xdab2421a42e499c7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584242.806401:0:22748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1784584242.806541:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9200/0xdab2421a42e499c0 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee96a expref: 23 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.806558:0:22748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9600/0xdab2421a42e499c7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee96a expref: 22 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.806566:0:22748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98b422413600) 00010000:00010000:0.0:1784584242.806570:0:22748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784584242.806573:0:22748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b9600, rc 0) 00000100:00100000:0.0:1784584242.806645:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b436ec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+22:18750:x1871271580301056:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 446us (922us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1784584242.806652:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 40 00000100:00100000:3.0:1784584242.816559:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584242.816610:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584242.816745:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580301184 00000100:00100000:2.0:1784584242.816756:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580301184 00000100:00100000:2.0:1784584242.816824:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 41 00000100:00100000:2.0:1784584242.816834:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b436ec2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+22:18750:x1871271580301184:12345-192.168.203.51@tcp:54:lfs.0 00010000:00010000:2.0:1784584242.816900:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e499d5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584242.816917:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e499d5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584242.816930:0:22747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e499d5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584242.816983:0:22747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e499d5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584242.816990:0:22747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e499d5 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584242.816997:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e499d5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584242.817004:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1600 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784584242.817008:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e499d5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584242.817033:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e499d5 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584242.817047:0:22747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98b422413600) 00010000:00010000:2.0:1784584242.817049:0:22747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784584242.817054:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e499d5 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584242.817060:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1600/0xdab2421a42e499d5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584242.817136:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b436ec2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+22:18750:x1871271580301184:12345-192.168.203.51@tcp:54:lfs.0 Request processed in 302us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584242.817143:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 41 00000100:00100000:0.0:1784584242.818080:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580301312 00000100:00100000:0.0:1784584242.818088:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580301312 00000100:00100000:0.0:1784584242.818133:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:0.0:1784584242.818142:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b436ec0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+22:2399:x1871271580301312:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784584242.818155:0:22732:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584242.818184:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b9600/0xdab2421a42e499c7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee96a expref: 22 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584242.818200:0:22732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98b422413600) 00010000:00010000:0.0:1784584242.818205:0:22732:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584242.818244:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b436ec0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+21:2399:x1871271580301312:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 103us (1633us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584242.818251:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:3.0:1784584242.821924:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584242.822168:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580301568 00000100:00100000:1.0:1784584242.822178:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580301568 00000100:00100000:1.0:1784584242.822240:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:1.0:1784584242.822250:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b436ec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+21:18750:x1871271580301568:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:1.0:1784584242.822665:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b436ec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+22:18750:x1871271580301568:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 414us (749us total) trans 12884901902 rc 0/0 00000100:00100000:1.0:1784584242.822674:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:2.0:1784584242.861864:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599268352:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784584242.861949:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584242.862047:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599268352 00000100:00100000:3.0:1784584242.862055:0:24258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599268352 00000100:00100000:3.0:1784584242.862114:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784584242.862124:0:24258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599268352:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1784584242.862145:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1784584242.862152:0:24258:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1784584242.862196:0:24258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599268352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584242.862456:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599268352:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784584242.869375:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 10000000:01000000:3.0:1784584243.054001:0:22744:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784584243.054009:0:22744:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b302b3b000 from 13 10000000:01000000:3.0:1784584243.054015:0:22744:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784584243.054073:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8400/0xdab2421a42e499dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.054118:0:22744:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8400/0xdab2421a42e499dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.054130:0:22744:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8400/0xdab2421a42e499dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584243.054158:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599268480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784584243.054237:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584243.054300:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3028620c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784584243.054395:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599268480 00000100:00100000:0.0:1784584243.054403:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599268480 00000100:00100000:0.0:1784584243.054460:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1784584243.054495:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+20:22744:x1871271599268480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584243.054509:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584243.054522:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b4332b9200/0xdab2421a42e499e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e499dc expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.054546:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4332b9200/0xdab2421a42e499e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e499dc expref: 21 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.054557:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b4332b9200/0xdab2421a42e499e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e499dc expref: 21 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.054566:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b9200, rc 0) 00000100:00100000:0.0:1784584243.054620:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+21:22744:x1871271599268480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584243.054627:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1784584243.054808:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599268480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784584243.054823:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8400/0xdab2421a42e499dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e499e3 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.054832:0:22744:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8400/0xdab2421a42e499dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e499e3 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584243.054891:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599268608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784584243.054917:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584243.054946:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3028620c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584243.055007:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599268608 00000100:00100000:1.0:1784584243.055012:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599268608 00000100:00100000:1.0:1784584243.055045:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1784584243.055052:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+21:22744:x1871271599268608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784584243.055161:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+21:22744:x1871271599268608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584243.055168:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1784584243.055410:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599268608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784584243.055441:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599268736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784584243.055505:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584243.055532:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3028620c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584243.055586:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599268736 00000100:00100000:2.0:1784584243.055591:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599268736 00000100:00100000:2.0:1784584243.055626:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1784584243.055634:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+21:22744:x1871271599268736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784584243.055731:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+21:22744:x1871271599268736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584243.055738:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1784584243.055922:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599268736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784584243.056750:0:25792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1784584243.056974:0:22744:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1784584243.057005:0:22744:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784584243.057015:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8400/0xdab2421a42e499dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e499e3 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.057024:0:22744:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b43ebd8400/0xdab2421a42e499dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e499e3 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584243.057033:0:22744:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784584243.057036:0:22744:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b41073b800 from 13 10000000:01000000:3.0:1784584243.057038:0:22744:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784584243.057068:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9200/0xdab2421a42e499ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.057077:0:22744:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9200/0xdab2421a42e499ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.057087:0:22744:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9200/0xdab2421a42e499ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584243.057106:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599268864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784584243.057152:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584243.057181:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3028620c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784584243.057402:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599268864 00000100:00100000:0.0:1784584243.057408:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599268864 00000100:00100000:0.0:1784584243.057453:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1784584243.057493:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+21:22744:x1871271599268864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584243.057507:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584243.057519:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b4332b9600/0xdab2421a42e499f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e499ea expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.057539:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4332b9600/0xdab2421a42e499f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e499ea expref: 22 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.057549:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b4332b9600/0xdab2421a42e499f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e499ea expref: 22 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.057556:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b9600, rc 0) 00000100:00100000:0.0:1784584243.057604:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+22:22744:x1871271599268864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584243.057611:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1784584243.057842:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599268864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784584243.057856:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9200/0xdab2421a42e499ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e499f1 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.057865:0:22744:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9200/0xdab2421a42e499ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e499f1 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584243.057927:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599268992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784584243.057960:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584243.057983:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3028620c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584243.058110:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599268992 00000100:00100000:1.0:1784584243.058115:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599268992 00000100:00100000:1.0:1784584243.058187:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1784584243.058196:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+22:22744:x1871271599268992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784584243.058314:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+22:22744:x1871271599268992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584243.058328:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1784584243.058393:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599268992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784584243.058420:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599269120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784584243.058460:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584243.058667:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b3028620c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584243.058866:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599269120 00000100:00100000:2.0:1784584243.058871:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599269120 00000100:00100000:2.0:1784584243.058902:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1784584243.058919:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+22:22744:x1871271599269120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784584243.059009:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+22:22744:x1871271599269120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584243.059016:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1784584243.059095:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599269120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784584243.060077:0:25793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1784584243.060498:0:22744:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1784584243.060518:0:22744:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784584243.060528:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9200/0xdab2421a42e499ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e499f1 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.060538:0:22744:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b43ebd9200/0xdab2421a42e499ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e499f1 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584243.060548:0:22744:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784584243.060550:0:22744:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b4049d6000 from 13 10000000:01000000:2.0:1784584243.060553:0:22744:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784584243.060584:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b3041c1600/0xdab2421a42e499f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.060591:0:22744:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b3041c1600/0xdab2421a42e499f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.060600:0:22744:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b3041c1600/0xdab2421a42e499f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584243.060620:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303961c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599269248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784584243.060668:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584243.060733:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599269248 00000100:00100000:0.0:1784584243.060739:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599269248 00000100:00100000:0.0:1784584243.060779:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1784584243.060788:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+22:22744:x1871271599269248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584243.060799:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584243.060812:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b4332b8e00/0xdab2421a42e499ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e499f8 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.060832:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b4332b8e00/0xdab2421a42e499ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e499f8 expref: 23 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.060843:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b4332b8e00/0xdab2421a42e499ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e499f8 expref: 23 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.060938:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b8e00, rc 0) 00000100:00100000:0.0:1784584243.060977:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+23:22744:x1871271599269248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584243.060983:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1784584243.060994:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b417259480 going to sleep for 11 seconds 00000100:00100000:2.0:1784584243.061011:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303961c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599269248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784584243.061031:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b3041c1600/0xdab2421a42e499f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e499ff expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.061040:0:22744:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b3041c1600/0xdab2421a42e499f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e499ff expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584243.061091:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303961c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599269376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784584243.061117:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584243.061164:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599269376 00000100:00100000:2.0:1784584243.061167:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b417259480 going to sleep for 11 seconds 00000100:00100000:0.0:1784584243.061168:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599269376 00000100:00100000:1.0:1784584243.061206:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1784584243.061215:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+23:22744:x1871271599269376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784584243.061393:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+23:22744:x1871271599269376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 180us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584243.061400:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1784584243.061447:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303961c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599269376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784584243.061610:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303961c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599269504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784584243.061650:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584243.061667:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b417259480 going to sleep for 11 seconds 00000100:00100000:0.0:1784584243.061833:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599269504 00000100:00100000:0.0:1784584243.061838:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599269504 00000100:00100000:0.0:1784584243.061860:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1784584243.061866:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+23:22744:x1871271599269504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784584243.061959:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:954867da-9a7c-4a17-b608-74c1de1cda93+23:22744:x1871271599269504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584243.061966:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1784584243.062127:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303961c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599269504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784584243.063259:0:25794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1784584243.063440:0:22744:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1784584243.063461:0:22744:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784584243.063537:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b3041c1600/0xdab2421a42e499f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e499ff expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.063549:0:22744:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b3041c1600/0xdab2421a42e499f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e499ff expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584243.063560:0:22744:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784584243.063563:0:22744:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98b405f11000 from 13 10000000:01000000:2.0:1784584243.063565:0:22744:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784584243.063599:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b3041c0e00/0xdab2421a42e49a06 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.063622:0:22744:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff98b3041c0e00/0xdab2421a42e49a06 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.063632:0:22744:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff98b3041c0e00/0xdab2421a42e49a06 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584243.063650:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303961c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599269632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784584243.063801:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584243.063870:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b417259480 going to sleep for 11 seconds 00000100:00100000:1.0:1784584243.063972:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599269632 00000100:00100000:1.0:1784584243.063979:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599269632 00000100:00100000:1.0:1784584243.064026:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1784584243.064035:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+23:22744:x1871271599269632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784584243.064046:0:22741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584243.064058:0:22741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98b42f194e00/0xdab2421a42e49a0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdab2421a42e49a06 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.064077:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98b42f194e00/0xdab2421a42e49a0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdab2421a42e49a06 expref: 24 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.064087:0:22741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98b42f194e00/0xdab2421a42e49a0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdab2421a42e49a06 expref: 24 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.064094:0:22741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b42f194e00, rc 0) 00000100:00100000:1.0:1784584243.064207:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+24:22744:x1871271599269632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584243.064214:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1784584243.064276:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303961c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599269632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784584243.064292:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff98b3041c0e00/0xdab2421a42e49a06 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e49a0d expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.064300:0:22744:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff98b3041c0e00/0xdab2421a42e49a06 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdab2421a42e49a0d expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584243.064362:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303961c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599269760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784584243.064388:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584243.064439:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b417259480 going to sleep for 11 seconds 00000100:00100000:3.0:1784584243.064582:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599269760 00000100:00100000:3.0:1784584243.064587:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599269760 00000100:00100000:3.0:1784584243.064656:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1784584243.064664:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+24:22744:x1871271599269760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784584243.064878:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+24:22744:x1871271599269760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 215us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584243.064886:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1784584243.065074:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303961c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599269760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784584243.065103:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303961c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599269888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784584243.065139:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584243.065200:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b417259480 going to sleep for 11 seconds 00000100:00100000:3.0:1784584243.065234:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599269888 00000100:00100000:3.0:1784584243.065238:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599269888 00000100:00100000:3.0:1784584243.065275:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1784584243.065282:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+24:22744:x1871271599269888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784584243.065361:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:954867da-9a7c-4a17-b608-74c1de1cda93+24:22744:x1871271599269888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584243.065369:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1784584243.065443:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303961c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:954867da-9a7c-4a17-b608-74c1de1cda93:22744:1871271599269888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784584243.066795:0:25795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1784584243.067050:0:22744:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1784584243.067071:0:22744:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784584243.067086:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff98b3041c0e00/0xdab2421a42e49a06 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e49a0d expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.067098:0:22744:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff98b3041c0e00/0xdab2421a42e49a06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdab2421a42e49a0d expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584243.112132:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584243.112384:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580301824 00000100:00100000:3.0:1784584243.112394:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580301824 00000100:00100000:3.0:1784584243.112518:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 42 00000100:00100000:3.0:1784584243.112528:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+22:18781:x1871271580301824:12345-192.168.203.51@tcp:101:cat.0 00010000:00010000:3.0:1784584243.112564:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584243.112595:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e49a14 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee971 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.112754:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e49a1b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.112768:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e49a1b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.112791:0:22749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e49a1b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584243.112810:0:22749:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1784584243.112939:0:22749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e49a14 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee971 expref: 25 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.112959:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e49a1b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee971 expref: 24 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.112983:0:22749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98b422413600) 00010000:00010000:3.0:1784584243.112985:0:22749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784584243.112988:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd8a00, rc 0) 00000100:00100000:3.0:1784584243.113730:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+24:18781:x1871271580301824:12345-192.168.203.51@tcp:101:cat.0 Request processed in 1199us (1602us total) trans 12884901903 rc 0/0 00000100:00100000:3.0:1784584243.113754:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 42 00000100:00100000:3.0:1784584243.118138:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584243.118518:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580302080 00000100:00100000:2.0:1784584243.118544:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580302080 00000100:00100000:2.0:1784584243.118650:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:2.0:1784584243.118661:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+24:18781:x1871271580302080:12345-192.168.203.51@tcp:35:cat.0 00000100:00100000:2.0:1784584243.118949:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+25:18781:x1871271580302080:12345-192.168.203.51@tcp:35:cat.0 Request processed in 289us (830us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1784584243.118956:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:2.0:1784584243.120698:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584243.120817:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580302208 00000100:00100000:0.0:1784584243.120824:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580302208 00000100:00100000:0.0:1784584243.120883:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 1 00000100:00100000:0.0:1784584243.120892:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303960380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+25:2400:x1871271580302208:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784584243.120906:0:22734:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584243.120930:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e49a1b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee971 expref: 25 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.120946:0:22734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98b422413600) 00010000:00010000:0.0:1784584243.120951:0:22734:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584243.121007:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303960380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+24:2400:x1871271580302208:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 116us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584243.121031:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 1 00000100:00100000:3.0:1784584243.174715:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584243.179742:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580302464 00000100:00100000:2.0:1784584243.179769:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580302464 00000100:00100000:2.0:1784584243.179859:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 43 00000100:00100000:2.0:1784584243.179871:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+24:18787:x1871271580302464:12345-192.168.203.51@tcp:101:dd.0 00010000:00010000:2.0:1784584243.179898:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584243.179917:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e49a29 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee978 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.180020:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e49a30 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.180035:0:22747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49996 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee955 expref: 25 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.180042:0:22747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e499ab lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee95c expref: 25 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.180050:0:22747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e49a30 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.180102:0:22747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e499ab lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee95c expref: 25 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.180116:0:22747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e499ab lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee95c expref: 25 pid: 22748 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584243.180129:0:22747:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22747:1871271599270016:192.168.203.51@tcp:104: 00010000:00010000:2.0:1784584243.180235:0:22747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49996 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee955 expref: 25 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.180245:0:22747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49996 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee955 expref: 25 pid: 22747 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584243.180255:0:22747:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22747:1871271599270144:192.168.203.51@tcp:104: 00000100:00100000:2.0:1784584243.180287:0:22747:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b417259540 going to sleep for 11 seconds 00010000:00010000:0.0:1784584243.183099:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584243.187432:0:22747:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22747:1871271599270016:192.168.203.51@tcp:104: 00000100:00100000:2.0:1784584243.187454:0:22747:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22747:1871271599270144:192.168.203.51@tcp:104: 00010000:00010000:2.0:1784584243.187513:0:22747:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e49a30 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584243.188298:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584243.188459:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580302592 00000100:00100000:0.0:1784584243.188498:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580302592 00010000:00010000:0.0:1784584243.188534:0:22732:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e499ab lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee95c expref: 26 pid: 22748 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584243.188566:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:0.0:1784584243.188574:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+26:2400:x1871271580302592:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784584243.188586:0:22732:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584243.188593:0:22732:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e499ab lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee95c expref: 26 pid: 22748 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.188606:0:22732:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e499ab lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee95c expref: 26 pid: 22748 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.188628:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e499ab lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee95c expref: 26 pid: 22748 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.188644:0:22732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98b422413600) 00010000:00010000:0.0:1784584243.188649:0:22732:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e49a30 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.188658:0:22732:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e49a30 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.188665:0:22732:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584243.188738:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+25:2400:x1871271580302592:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 163us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584243.188746:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:3.0:1784584243.192580:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584243.193074:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580302720 00000100:00100000:1.0:1784584243.193084:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580302720 00010000:00010000:1.0:1784584243.193124:0:22733:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49996 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee955 expref: 25 pid: 22747 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584243.193180:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:1.0:1784584243.193190:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30429f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+25:2400:x1871271580302720:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784584243.193210:0:22733:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584243.193217:0:22733:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49996 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee955 expref: 25 pid: 22747 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.193231:0:22733:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49996 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee955 expref: 25 pid: 22747 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.193252:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49996 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee955 expref: 25 pid: 22747 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.193279:0:22733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98b422413600) 00010000:00010000:1.0:1784584243.193285:0:22733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e49a30 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.193294:0:22733:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e49a30 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.193301:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e49a30 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.193335:0:22733:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584243.193389:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30429f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+24:2400:x1871271580302720:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 200us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584243.193396:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 18 00010000:00010000:2.0:1784584243.193492:0:22747:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e49a30 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.193503:0:22747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e49a30 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584243.193531:0:22747:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1784584243.193745:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e49a29 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee978 expref: 25 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.193763:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1a00/0xdab2421a42e49a30 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee978 expref: 24 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.193771:0:22747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98b422413600) 00010000:00010000:2.0:1784584243.193774:0:22747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784584243.193776:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c1a00, rc 0) 00000100:00100000:2.0:1784584243.193802:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+24:18787:x1871271580302464:12345-192.168.203.51@tcp:101:dd.0 Request processed in 13933us (19097us total) trans 12884901905 rc 0/0 00000100:00100000:2.0:1784584243.193808:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 43 00000100:00100000:2.0:1784584243.206336:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584243.206445:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580302848 00000100:00100000:0.0:1784584243.206454:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580302848 00000100:00100000:0.0:1784584243.206545:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 44 00000100:00100000:0.0:1784584243.206555:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+24:18787:x1871271580302848:12345-192.168.203.51@tcp:101:dd.0 00010000:00010000:0.0:1784584243.206579:0:22748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584243.206610:0:22748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49a3e lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee97f expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.206649:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8600/0xdab2421a42e49a45 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.206662:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8600/0xdab2421a42e49a45 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.206674:0:22748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8600/0xdab2421a42e49a45 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.206800:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49a3e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee97f expref: 26 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.206818:0:22748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8600/0xdab2421a42e49a45 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee97f expref: 25 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.206827:0:22748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98b422413600) 00010000:00010000:0.0:1784584243.206830:0:22748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784584243.206833:0:22748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b4332b8600, rc 0) 00000100:00100000:0.0:1784584243.206893:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+25:18787:x1871271580302848:12345-192.168.203.51@tcp:101:dd.0 Request processed in 339us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584243.206900:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 44 00000100:00100000:3.0:1784584243.214779:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584243.219751:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580303104 00000100:00100000:0.0:1784584243.219766:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580303104 00000100:00100000:0.0:1784584243.219840:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 45 00000100:00100000:0.0:1784584243.219851:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+25:18787:x1871271580303104:12345-192.168.203.51@tcp:36:dd.0 00010000:00010000:0.0:1784584243.222242:0:23817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49a4c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.222282:0:23817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49a4c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.222294:0:23817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49a4c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784584243.224174:0:23817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901906 00000004:00010000:0.0:1784584243.224235:0:23817:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000016bcd6fb reply state 000000005affabd9 transno 12884901907 ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49a4c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.224259:0:23817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49a4c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.224279:0:23817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98b422413600) 00010000:00010000:0.0:1784584243.224282:0:23817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784584243.224286:0:23817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784584243.224417:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+28:18787:x1871271580303104:12345-192.168.203.51@tcp:36:dd.0 Request processed in 4565us (9645us total) trans 12884901907 rc 0/0 00000100:00100000:0.0:1784584243.224427:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 45 00000020:00080000:0.0:1784584243.224433:0:23817:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784584243.232783:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584243.232972:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580303232 00000100:00100000:0.0:1784584243.233092:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580303232 00000100:00100000:0.0:1784584243.233155:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 46 00000100:00100000:0.0:1784584243.233165:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+28:18787:x1871271580303232:12345-192.168.203.51@tcp:101:dd.0 00010000:00010000:0.0:1784584243.233189:0:22748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584243.233223:0:22748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f182c00/0xdab2421a42e49a53 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee986 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.233293:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f182c00/0xdab2421a42e49a53 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee986 expref: 29 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.233309:0:22748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f182c00/0xdab2421a42e49a53 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee986 expref: 29 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.233327:0:22748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98b422413600) 00010000:00010000:0.0:1784584243.233330:0:22748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784584243.233334:0:22748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b42f182c00, rc 0) 00000100:00100000:0.0:1784584243.233398:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+29:18787:x1871271580303232:12345-192.168.203.51@tcp:101:dd.0 Request processed in 233us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584243.233405:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 46 00000100:00100000:2.0:1784584243.252380:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584243.252683:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580303488 00000100:00100000:1.0:1784584243.252692:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580303488 00000100:00100000:1.0:1784584243.252755:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 2 00000100:00100000:1.0:1784584243.252766:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+29:18787:x1871271580303488:12345-192.168.203.51@tcp:103:dd.0 00010000:00010000:1.0:1784584243.252790:0:22734:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584243.252815:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f182c00/0xdab2421a42e49a53 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee986 expref: 29 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.252834:0:22734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98b422413600) 00010000:00010000:1.0:1784584243.252839:0:22734:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584243.252896:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+28:18787:x1871271580303488:12345-192.168.203.51@tcp:103:dd.0 Request processed in 132us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584243.252904:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 2 00000100:00100000:2.0:1784584243.255638:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584243.255758:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580303616 00000100:00100000:3.0:1784584243.255775:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580303616 00000100:00100000:3.0:1784584243.255833:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 47 00000100:00100000:3.0:1784584243.255842:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+28:18787:x1871271580303616:12345-192.168.203.51@tcp:58:dd.0 00010000:00010000:3.0:1784584243.255972:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e49a5a lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.255988:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e49a5a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.255999:0:22747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e49a5a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784584243.257068:0:22747:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784584243.257100:0:22747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:3.0:1784584243.257343:0:22747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:3.0:1784584243.257455:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+28:18787:x1871271580303616:12345-192.168.203.51@tcp:58:dd.0 Request processed in 1610us (1823us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584243.257465:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 47 00000100:00100000:3.0:1784584243.262722:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584243.265981:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580303744 00000100:00100000:0.0:1784584243.265999:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580303744 00000100:00100000:1.0:1784584243.269492:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 48 00000100:00100000:1.0:1784584243.269506:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f281500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+28:18787:x1871271580303744:12345-192.168.203.51@tcp:101:dd.0 00010000:00010000:1.0:1784584243.269526:0:22748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584243.269546:0:22748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f195c00/0xdab2421a42e49a61 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee98d expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.269598:0:22748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e49a5a lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.269609:0:22748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f195c00/0xdab2421a42e49a61 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee98d expref: 29 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.269639:0:22748:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e49a5a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.269666:0:22748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f195c00/0xdab2421a42e49a61 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee98d expref: 29 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.269679:0:22748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98b422413600) 00010000:00010000:1.0:1784584243.269682:0:22748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784584243.269686:0:22748:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f195c00/0xdab2421a42e49a61 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee98d expref: 29 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.269693:0:22748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b42f195c00, rc 0) 00000100:00100000:1.0:1784584243.269754:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f281500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+29:18787:x1871271580303744:12345-192.168.203.51@tcp:101:dd.0 Request processed in 251us (7042us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584243.269761:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 48 00000040:00080000:0.0:1784584243.629695:0:22782:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1784584243.629705:0:22782:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784584243.629752:0:22782:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1784584243.629762:0:22782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1784584243.629918:0:22782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404954000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22782:1871271599270272:192.168.203.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784584243.630007:0:22782:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b417259540 going to sleep for 11 seconds 00000100:00100000:0.0:1784584243.635606:0:22782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404954000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22782:1871271599270272:192.168.203.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784584243.645521:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584243.647404:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580303872 00000100:00100000:0.0:1784584243.647417:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580303872 00000100:00100000:0.0:1784584243.647509:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 49 00000100:00100000:0.0:1784584243.647519:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+29:18788:x1871271580303872:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784584243.647550:0:23817:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784584243.647670:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+29:18788:x1871271580303872:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 Request processed in 152us (2157us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584243.647678:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 49 00000100:00100000:3.0:1784584243.659861:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584243.660090:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580304000 00000100:00100000:1.0:1784584243.660100:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580304000 00000100:00100000:1.0:1784584243.660163:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 50 00000100:00100000:1.0:1784584243.660174:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+29:18788:x1871271580304000:12345-192.168.203.51@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1784584243.660247:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194600/0xdab2421a42e49a68 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.660277:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194600/0xdab2421a42e49a68 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.660291:0:22749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194600/0xdab2421a42e49a68 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.660356:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194a00/0xdab2421a42e49a6f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.660381:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194a00/0xdab2421a42e49a6f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.660388:0:22749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194a00/0xdab2421a42e49a6f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.660415:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194200/0xdab2421a42e49a76 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.660424:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194200/0xdab2421a42e49a76 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.660431:0:22749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194200/0xdab2421a42e49a76 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584243.660515:0:22749:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1784584243.660520:0:22749:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784584243.660535:0:22749:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194200/0xdab2421a42e49a76 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.660547:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194600/0xdab2421a42e49a68 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.660555:0:22749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194600/0xdab2421a42e49a68 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.660562:0:22749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194600/0xdab2421a42e49a68 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.660569:0:22749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b42f194600 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784584243.660572:0:22749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194600/0xdab2421a42e49a68 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.660587:0:22749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194600/0xdab2421a42e49a68 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.660600:0:22749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98b43e8abb00) 00010000:00010000:1.0:1784584243.660603:0:22749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584243.660608:0:22749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194600/0xdab2421a42e49a68 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.660615:0:22749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194600/0xdab2421a42e49a68 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.660628:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194a00/0xdab2421a42e49a6f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.660634:0:22749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194a00/0xdab2421a42e49a6f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.660640:0:22749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194a00/0xdab2421a42e49a6f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.660646:0:22749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b42f194a00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784584243.660648:0:22749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194a00/0xdab2421a42e49a6f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.660655:0:22749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194a00/0xdab2421a42e49a6f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.660662:0:22749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff98b30397bb00) 00010000:00010000:1.0:1784584243.660665:0:22749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584243.660668:0:22749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194a00/0xdab2421a42e49a6f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.660685:0:22749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194a00/0xdab2421a42e49a6f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.660700:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194200/0xdab2421a42e49a76 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.660706:0:22749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194200/0xdab2421a42e49a76 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.660712:0:22749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194200/0xdab2421a42e49a76 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.660717:0:22749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b42f194200 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784584243.660720:0:22749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194200/0xdab2421a42e49a76 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.660726:0:22749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194200/0xdab2421a42e49a76 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.660735:0:22749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98b422413600) 00010000:00010000:1.0:1784584243.660737:0:22749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584243.660740:0:22749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194200/0xdab2421a42e49a76 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.660746:0:22749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194200/0xdab2421a42e49a76 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584243.660827:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+29:18788:x1871271580304000:12345-192.168.203.51@tcp:34:lhsmtool_posix.0 Request processed in 654us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584243.660836:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 50 00000100:00100000:2.0:1784584243.672331:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584243.672416:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580304256 00000100:00100000:3.0:1784584243.672426:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580304256 00000100:00100000:3.0:1784584243.672528:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 51 00000100:00100000:3.0:1784584243.672539:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+29:18788:x1871271580304256:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784584243.672561:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584243.672582:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e49a7d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee994 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.672818:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e49a84 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.672835:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e49a84 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.672847:0:22747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e49a84 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584243.672857:0:22747:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1784584243.674149:0:22747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e49a84 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.674164:0:22747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e49a84 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.674172:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e49a84 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.674193:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8600 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784584243.674198:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e49a84 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.674206:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e49a84 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.674221:0:22747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98b422413600) 00010000:00010000:3.0:1784584243.674224:0:22747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784584243.674228:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e49a84 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.674234:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e49a84 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.674294:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e49a7d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee994 expref: 31 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.674304:0:22747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98b43e8abb00) 00010000:00010000:3.0:1784584243.674306:0:22747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784584243.674310:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e49a7d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee994 expref: 31 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.674319:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd8200, rc 0) 00000100:00100000:3.0:1784584243.674392:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+30:18788:x1871271580304256:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 1854us (2070us total) trans 12884901908 rc 301/301 00000100:00100000:3.0:1784584243.674402:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 51 00000100:00100000:2.0:1784584243.678917:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584243.679021:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580304384 00000100:00100000:1.0:1784584243.679030:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580304384 00000100:00100000:1.0:1784584243.679100:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 52 00000100:00100000:1.0:1784584243.679110:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+30:18788:x1871271580304384:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784584243.679151:0:22749:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784584243.679282:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+30:18788:x1871271580304384:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 Request processed in 172us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584243.679290:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 52 00000100:00100000:1.0:1784584243.682866:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584243.685905:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580304640 00000100:00100000:0.0:1784584243.685920:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580304640 00000100:00100000:0.0:1784584243.686005:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 53 00000100:00100000:0.0:1784584243.686016:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+30:18788:x1871271580304640:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784584243.686036:0:23817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584243.686056:0:23817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f182e00/0xdab2421a42e49a92 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee99b expref: -99 pid: 23817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784584243.686753:0:23817:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x23:0x0], count =31 00000004:00080000:0.0:1784584243.686760:0:23817:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x23:0x0]+31 in llog 00000004:00080000:0.0:1784584243.686841:0:23817:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:0.0:1784584243.687190:0:23817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f183200/0xdab2421a42e49a99 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.687206:0:23817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f183200/0xdab2421a42e49a99 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.687218:0:23817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f183200/0xdab2421a42e49a99 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.687301:0:23817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f182e00/0xdab2421a42e49a92 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee99b expref: 33 pid: 23817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.687321:0:23817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f183200/0xdab2421a42e49a99 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee99b expref: 32 pid: 23817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.687331:0:23817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98b303986a00) 00010000:00010000:0.0:1784584243.687334:0:23817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784584243.687337:0:23817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b42f183200, rc 0) 00000100:00100000:0.0:1784584243.687409:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+32:18788:x1871271580304640:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 1394us (4552us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1784584243.687418:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 53 00000100:00100000:2.0:1784584243.694228:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584243.696730:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580304896 00000100:00100000:1.0:1784584243.696745:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580304896 00000100:00100000:1.0:1784584243.696999:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 54 00000100:00100000:1.0:1784584243.697009:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+32:18788:x1871271580304896:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784584243.697069:0:22749:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584243.697105:0:22749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f183200/0xdab2421a42e49a99 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee99b expref: 32 pid: 23817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.697126:0:22749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98b303986a00) 00010000:00010000:1.0:1784584243.697136:0:22749:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784584243.697159:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194a00/0xdab2421a42e49aa7 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.697174:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194a00/0xdab2421a42e49aa7 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.697183:0:22749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194a00/0xdab2421a42e49aa7 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.697198:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194600/0xdab2421a42e49aae lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x4b213910 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.697221:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194600/0xdab2421a42e49aae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x4b213910 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.697229:0:22749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194600/0xdab2421a42e49aae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x4b213910 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.697291:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194a00/0xdab2421a42e49aa7 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.697298:0:22749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194a00/0xdab2421a42e49aa7 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.697305:0:22749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194a00/0xdab2421a42e49aa7 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.697311:0:22749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b42f194a00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784584243.697316:0:22749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194a00/0xdab2421a42e49aa7 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.697324:0:22749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194a00/0xdab2421a42e49aa7 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.697333:0:22749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98b43e8abf00) 00010000:00010000:1.0:1784584243.697336:0:22749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584243.697340:0:22749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194a00/0xdab2421a42e49aa7 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.697347:0:22749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194a00/0xdab2421a42e49aa7 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.697357:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194600/0xdab2421a42e49aae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x4b213910 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.697370:0:22749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194600/0xdab2421a42e49aae lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x4b213910 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.697376:0:22749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194600/0xdab2421a42e49aae lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x4b213910 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.697381:0:22749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b42f194600 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:1.0:1784584243.697384:0:22749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194600/0xdab2421a42e49aae lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x4b213910 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.697391:0:22749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194600/0xdab2421a42e49aae lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x4b213910 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.697400:0:22749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x4b213910 (ffff98b30397bb00) 00010000:00010000:1.0:1784584243.697402:0:22749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584243.697405:0:22749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194600/0xdab2421a42e49aae lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x4b213910 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.697411:0:22749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194600/0xdab2421a42e49aae lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x4b213910 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584243.697539:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+31:18788:x1871271580304896:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 530us (3319us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784584243.697547:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 54 00000100:00100000:2.0:1784584243.703338:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584243.703429:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580305024 00000100:00100000:0.0:1784584243.703440:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580305024 00000100:00100000:0.0:1784584243.703530:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 55 00000100:00100000:0.0:1784584243.703539:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+31:18788:x1871271580305024:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784584243.703559:0:23817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584243.703582:0:23817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f183c00/0xdab2421a42e49ab5 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee9a2 expref: -99 pid: 23817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.703628:0:23817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f182600/0xdab2421a42e49abc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.703642:0:23817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f182600/0xdab2421a42e49abc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.703654:0:23817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f182600/0xdab2421a42e49abc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.703789:0:23817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f183c00/0xdab2421a42e49ab5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9a2 expref: 33 pid: 23817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.703807:0:23817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f182600/0xdab2421a42e49abc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9a2 expref: 32 pid: 23817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.703816:0:23817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98b303986d00) 00010000:00010000:0.0:1784584243.703819:0:23817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784584243.703823:0:23817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b42f182600, rc 0) 00000100:00100000:0.0:1784584243.703875:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+32:18788:x1871271580305024:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 337us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584243.703883:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 55 00000100:00100000:2.0:1784584243.706517:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584243.706789:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580305280 00000100:00100000:3.0:1784584243.706810:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580305280 00000100:00100000:3.0:1784584243.706870:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 56 00000100:00100000:3.0:1784584243.706880:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+32:18788:x1871271580305280:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784584243.706981:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e49ac3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.706996:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e49ac3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.707007:0:22748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e49ac3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784584243.707403:0:22748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:3.0:1784584243.707413:0:22748:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 686892944723ns, next at 687892942473ns, rc = 0 00000004:00010000:3.0:1784584243.707462:0:22748:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b57c161f reply state 00000000ebbea6c5 transno 12884901910 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e49ac3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.707518:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e49ac3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.707526:0:22748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98b303986d00) 00010000:00010000:3.0:1784584243.707529:0:22748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1784584243.707532:0:22748:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784584243.707682:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+34:18788:x1871271580305280:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 803us (1213us total) trans 12884901910 rc 0/0 00000100:00100000:3.0:1784584243.707690:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 56 00000100:00100000:2.0:1784584243.715377:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584243.715534:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580305408 00000100:00100000:3.0:1784584243.715544:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580305408 00000100:00100000:3.0:1784584243.715606:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 57 00000100:00100000:3.0:1784584243.715617:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+34:18788:x1871271580305408:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784584243.715666:0:22747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584243.715689:0:22747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e49aca lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee9a9 expref: -99 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.715745:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e49aca lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9a9 expref: 35 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.715759:0:22747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e49aca lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9a9 expref: 35 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.715778:0:22747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98b303986d00) 00010000:00010000:3.0:1784584243.715781:0:22747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784584243.715784:0:22747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b43ebd8600, rc 0) 00000100:00100000:3.0:1784584243.715964:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+35:18788:x1871271580305408:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 347us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584243.715981:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 57 00000100:00100000:2.0:1784584243.729509:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584243.729597:0:24254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580305536 00000100:00100000:0.0:1784584243.729608:0:24254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580305536 00000100:00100000:0.0:1784584243.729689:0:24254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 20 00000100:00100000:0.0:1784584243.729700:0:24254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+5:2401:x1871271580305536:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1784584243.729947:0:24254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+6:2401:x1871271580305536:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 Request processed in 248us (483us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1784584243.729956:0:24254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 20 00000100:00080000:2.0:1784584243.730194:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784584243.736160:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584243.736338:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580305792 00000100:00100000:1.0:1784584243.736348:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580305792 00000100:00100000:1.0:1784584243.736408:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:1.0:1784584243.736419:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+35:18788:x1871271580305792:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1784584243.736686:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+36:18788:x1871271580305792:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 Request processed in 268us (535us total) trans 12884901911 rc 0/0 00000100:00100000:1.0:1784584243.736701:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:3.0:1784584243.738397:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584243.738511:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580306048 00000100:00100000:1.0:1784584243.738520:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580306048 00000100:00100000:1.0:1784584243.738574:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 58 00000100:00100000:1.0:1784584243.738584:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f281f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+36:18788:x1871271580306048:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1784584243.738691:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f281f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+36:18788:x1871271580306048:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 108us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584243.738698:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 58 00000100:00100000:3.0:1784584243.750624:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584243.750771:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580306176 00000100:00100000:1.0:1784584243.750781:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580306176 00000100:00100000:1.0:1784584243.750841:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 59 00000100:00100000:1.0:1784584243.750851:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+36:18788:x1871271580306176:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784584243.750872:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584243.750903:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194600/0xdab2421a42e49ad1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee9b0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.750987:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194a00/0xdab2421a42e49ad8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.751002:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194a00/0xdab2421a42e49ad8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.751014:0:22749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194a00/0xdab2421a42e49ad8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584243.751059:0:22749:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784584243.751257:0:22749:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194a00/0xdab2421a42e49ad8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.751310:0:22749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194600/0xdab2421a42e49ad1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9b0 expref: 38 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.751328:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194a00/0xdab2421a42e49ad8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9b0 expref: 37 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.751337:0:22749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98b303986d00) 00010000:00010000:1.0:1784584243.751340:0:22749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1784584243.751344:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b42f194a00, rc 0) 00000100:00100000:1.0:1784584243.751410:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+37:18788:x1871271580306176:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 561us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584243.751418:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 59 00000100:00100000:3.0:1784584243.753948:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584243.754235:0:24895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580306304 00000100:00100000:0.0:1784584243.754245:0:24895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580306304 00000100:00100000:0.0:1784584243.754313:0:24895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00100000:0.0:1784584243.754324:0:24895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+6:2400:x1871271580306304:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784584243.754344:0:24895:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584243.754367:0:24895:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058db1133/0xdab2421a42e49adf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee9b7 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784584243.754409:0:24895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5e9834, blocks: 0x0 00010000:00010000:0.0:1784584243.754428:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=686s v=(0 0) 00010000:00010000:0.0:1784584243.754433:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584243.754443:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058db1133/0xdab2421a42e49adf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9b7 expref: 7 pid: 24895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.754465:0:24895:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000058db1133/0xdab2421a42e49adf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9b7 expref: 7 pid: 24895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.754520:0:24895:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b42f183c00, rc 0) 00000100:00100000:0.0:1784584243.754574:0:24895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+7:2400:x1871271580306304:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 252us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584243.754581:0:24895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00100000:2.0:1784584243.759442:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584243.759584:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580306560 00000100:00100000:1.0:1784584243.759595:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580306560 00000100:00100000:1.0:1784584243.760823:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 60 00000100:00100000:1.0:1784584243.760839:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+37:18788:x1871271580306560:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1784584243.760973:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+37:18788:x1871271580306560:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 134us (1535us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584243.760982:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 60 00000100:00100000:1.0:1784584243.763458:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584243.763607:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580306688 00000100:00100000:3.0:1784584243.763626:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580306688 00000100:00100000:3.0:1784584243.763686:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 61 00000100:00100000:3.0:1784584243.763698:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+37:18788:x1871271580306688:12345-192.168.203.51@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1784584243.765789:0:22727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901911 is committed 00000004:00080000:1.0:1784584243.765805:0:22727:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1784584243.765856:0:22727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:1.0:1784584243.767393:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599270400:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1784584243.767465:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784584243.767941:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e49934 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.767952:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e49934 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.767964:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e49934 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.767983:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c0000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784584243.767988:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e49934 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.767996:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e49934 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.768012:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98b43e8abf00) 00010000:00010000:3.0:1784584243.768015:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1784584243.768020:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e49934 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.768027:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0000/0xdab2421a42e49934 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584243.768171:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+19:18788:x1871271580306688:12345-192.168.203.51@tcp:44:lhsmtool_posix.0 Request processed in 4472us (4718us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584243.768181:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 61 00000100:00100000:2.0:1784584243.768668:0:24253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599270400 00000100:00100000:2.0:1784584243.768676:0:24253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599270400 00000100:00100000:2.0:1784584243.768729:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784584243.768738:0:24253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599270400:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1784584243.768856:0:24253:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1784584243.768860:0:24253:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1784584243.768862:0:24253:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1784584243.768864:0:24253:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1784584244 -> 1784584244 00002000:00010000:2.0:1784584243.768866:0:24253:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1784584243.768922:0:24253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1871271599270400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 186us (1456us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1784584243.768930:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:2.0:1784584243.768978:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98b43766ea00/2, rc 0, transno 12884901892 00000100:00100000:2.0:1784584243.768985:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599270400:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1784584243.769325:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784584243.769422:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e498d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769432:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e498d2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769440:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e498d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769446:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9a00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784584243.769450:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e498d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769457:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e498d2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769506:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff98b43e8abd00) 00010000:00010000:0.0:1784584243.769509:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584243.769513:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e498d2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769521:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9a00/0xdab2421a42e498d2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769539:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e498d9 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769545:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e498d9 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769551:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e498d9 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769556:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8c00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784584243.769559:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e498d9 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769564:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e498d9 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769572:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98b43e8abf00) 00010000:00010000:0.0:1784584243.769574:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584243.769577:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e498d9 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769582:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8c00/0xdab2421a42e498d9 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769605:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4998f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769612:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4998f lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769618:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4998f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769622:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1e00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784584243.769625:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4998f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769631:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4998f lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769639:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff98b422413200) 00010000:00010000:0.0:1784584243.769641:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584243.769644:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4998f lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769650:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1e00/0xdab2421a42e4998f lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769665:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49a4c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769671:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49a4c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769677:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49a4c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769690:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b4332b8a00 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784584243.769693:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49a4c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769699:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49a4c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769708:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98b422413600) 00010000:00010000:0.0:1784584243.769710:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584243.769713:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49a4c lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769718:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8a00/0xdab2421a42e49a4c lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769730:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e49ac3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769736:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e49ac3 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769741:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e49ac3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769746:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8200 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:0.0:1784584243.769748:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e49ac3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769753:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e49ac3 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769772:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98b303986d00) 00010000:00010000:0.0:1784584243.769774:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784584243.769777:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e49ac3 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.769784:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8200/0xdab2421a42e49ac3 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584243.776228:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584243.781052:0:24254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580306816 00000100:00100000:0.0:1784584243.781078:0:24254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580306816 00000100:00100000:0.0:1784584243.781149:0:24254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 23 00000100:00100000:0.0:1784584243.781160:0:24254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+7:2401:x1871271580306816:12345-192.168.203.51@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1784584243.781277:0:24254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+7:2401:x1871271580306816:12345-192.168.203.51@tcp:16:lhsmtool_posix.0 Request processed in 118us (5057us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584243.781286:0:24254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 23 00000100:00100000:1.0:1784584243.786836:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584243.788195:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580307072 00000100:00100000:3.0:1784584243.788295:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580307072 00000100:00100000:3.0:1784584243.788410:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 62 00000100:00100000:3.0:1784584243.788421:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+15:18788:x1871271580307072:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784584243.788489:0:22748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584243.788515:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f194a00/0xdab2421a42e49ad8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9b0 expref: 15 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.788550:0:22748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98b303986d00) 00010000:00010000:3.0:1784584243.788555:0:22748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784584243.788584:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e49ae6 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.788599:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e49ae6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.788609:0:22748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e49ae6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784584243.788730:0:22748:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c9305a51 reply state 0000000053e40636 transno 12884901912 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e49ae6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.788744:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8a00/0xdab2421a42e49ae6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.788751:0:22748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98b303986d00) 00010000:00010000:3.0:1784584243.788754:0:22748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784584243.788757:0:22748:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784584243.788856:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+16:18788:x1871271580307072:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 436us (2027us total) trans 12884901912 rc 0/0 00000100:00100000:3.0:1784584243.788864:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 62 00000100:00100000:1.0:1784584243.794570:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584243.797616:0:24255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580307200 00000100:00100000:2.0:1784584243.797630:0:24255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580307200 00000100:00100000:2.0:1784584243.797908:0:24255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 24 00000100:00100000:2.0:1784584243.797920:0:24255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+7:18788:x1871271580307200:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784584243.797939:0:24255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584243.798528:0:24255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014f055f7/0xdab2421a42e49aed lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee9be expref: -99 pid: 24255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.798566:0:24255:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000058db1133/0xdab2421a42e49adf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9b7 expref: 8 pid: 24895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.798594:0:24255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584243.798599:0:24255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584243.798605:0:24255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014f055f7/0xdab2421a42e49aed lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9be expref: 8 pid: 24255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.798643:0:24255:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000058db1133/0xdab2421a42e49adf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9b7 expref: 8 pid: 24895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.798659:0:24255:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000058db1133/0xdab2421a42e49adf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9b7 expref: 8 pid: 24895 timeout: 786 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584243.798675:0:24255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b43766dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:24255:1871271599270528:192.168.203.51@tcp:104: 00000100:00100000:2.0:1784584243.798798:0:24255:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a2d4180 going to sleep for 11 seconds 00000100:00100000:2.0:1784584243.809644:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584243.809885:0:24255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b43766dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:24255:1871271599270528:192.168.203.51@tcp:104: 00010000:00010000:3.0:1784584243.809918:0:24255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000014f055f7/0xdab2421a42e49aed lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9be expref: 8 pid: 24255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.809938:0:24255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c0000, rc 0) 00000100:00100000:3.0:1784584243.810019:0:24255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+8:18788:x1871271580307200:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 12101us (15459us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584243.810027:0:24255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 24 00000100:00100000:1.0:1784584243.811319:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580307328 00000100:00100000:1.0:1784584243.811330:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580307328 00010000:00010000:1.0:1784584243.811372:0:22733:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000058db1133/0xdab2421a42e49adf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9b7 expref: 8 pid: 24895 timeout: 786 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584243.811426:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 19 00000100:00100000:1.0:1784584243.811436:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+8:2401:x1871271580307328:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784584243.811452:0:22733:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584243.811509:0:22733:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000058db1133/0xdab2421a42e49adf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9b7 expref: 8 pid: 24895 timeout: 786 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.811524:0:22733:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000058db1133/0xdab2421a42e49adf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9b7 expref: 8 pid: 24895 timeout: 786 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.811548:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058db1133/0xdab2421a42e49adf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9b7 expref: 8 pid: 24895 timeout: 786 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.811563:0:22733:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584243.811566:0:22733:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584243.811573:0:22733:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000014f055f7/0xdab2421a42e49aed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9be expref: 7 pid: 24255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.811583:0:22733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014f055f7/0xdab2421a42e49aed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9be expref: 7 pid: 24255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.811641:0:22733:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000014f055f7/0xdab2421a42e49aed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9be expref: 7 pid: 24255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584243.811656:0:22733:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303851c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:22733:1871271599270656:192.168.203.51@tcp:105: 00000100:00100000:1.0:1784584243.811781:0:22733:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b430b18b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784584243.815909:0:22733:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303851c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:22733:1871271599270656:192.168.203.51@tcp:105: 00010000:00010000:1.0:1784584243.815936:0:22733:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584243.816072:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+7:2401:x1871271580307328:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 4636us (6434us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584243.816085:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 19 00000100:00100000:2.0:1784584243.820595:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584243.820696:0:25386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580307456 00000100:00100000:1.0:1784584243.820705:0:25386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580307456 00000100:00100000:1.0:1784584243.820775:0:25386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 25 00000100:00100000:1.0:1784584243.820785:0:25386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+7:2400:x1871271580307456:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1784584243.820946:0:25386:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1784584243.820950:0:25386:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1784584243 00002000:00010000:1.0:1784584243.820953:0:25386:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1784584242 00002000:00010000:1.0:1784584243.820955:0:25386:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1784584244 -> 1784584243 00002000:00010000:1.0:1784584243.820957:0:25386:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1784584243.821019:0:25386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+8:2400:x1871271580307456:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 Request processed in 235us (432us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1784584243.821027:0:25386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 25 00000100:00100000:2.0:1784584243.826856:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584243.826936:0:24895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580307584 00000100:00100000:3.0:1784584243.826946:0:24895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580307584 00000100:00100000:3.0:1784584243.827009:0:24895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 26 00000100:00100000:3.0:1784584243.827019:0:24895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+8:2401:x1871271580307584:12345-192.168.203.51@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1784584243.827062:0:24895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e49af4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.827082:0:24895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000014f055f7/0xdab2421a42e49aed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9be expref: 8 pid: 24255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.827217:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1784584243.827221:0:24895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784584243.827227:0:24895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e49af4 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.827266:0:24895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000014f055f7/0xdab2421a42e49aed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9be expref: 8 pid: 24255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.827281:0:24895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000014f055f7/0xdab2421a42e49aed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9be expref: 8 pid: 24255 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584243.827295:0:24895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f283480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:24895:1871271599270784:192.168.203.51@tcp:104: 00000100:00100000:3.0:1784584243.827375:0:24895:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b42030f000 going to sleep for 11 seconds 00000100:00100000:2.0:1784584243.832191:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584243.832569:0:24895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f283480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:24895:1871271599270784:192.168.203.51@tcp:104: 00010000:00010000:3.0:1784584243.832599:0:24895:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e49af4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584243.833235:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580307712 00000100:00100000:0.0:1784584243.833244:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580307712 00010000:00010000:0.0:1784584243.833295:0:22732:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000014f055f7/0xdab2421a42e49aed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9be expref: 9 pid: 24255 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584243.833339:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 20 00000100:00100000:0.0:1784584243.833348:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+9:2401:x1871271580307712:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784584243.833375:0:22732:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584243.833398:0:22732:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000014f055f7/0xdab2421a42e49aed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9be expref: 9 pid: 24255 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.833443:0:22732:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000014f055f7/0xdab2421a42e49aed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9be expref: 9 pid: 24255 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.833515:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014f055f7/0xdab2421a42e49aed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9be expref: 9 pid: 24255 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.833541:0:22732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784584243.833546:0:22732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784584243.833552:0:22732:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e49af4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.833561:0:22732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e49af4 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.833589:0:22732:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584243.833652:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+8:2401:x1871271580307712:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 304us (1469us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584243.833664:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 20 00010000:00010000:0.0:1784584243.833688:0:24895:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e49af4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.833696:0:24895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e49af4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.833714:0:24895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e49af4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.833728:0:24895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e49af4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.833737:0:24895:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e49af4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.833756:0:24895:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:0.0:1784584243.833760:0:24895:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e49af4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.833769:0:24895:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e49af4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.833788:0:24895:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e49af4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.833795:0:24895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7a9acad/0xdab2421a42e49af4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584243.833835:0:24895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+7:2401:x1871271580307584:12345-192.168.203.51@tcp:1:lhsmtool_posix.0 Request processed in 6817us (6989us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584243.833842:0:24895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 26 00000100:00100000:1.0:1784584243.838917:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584243.839065:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580307968 00000100:00100000:2.0:1784584243.839074:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580307968 00000100:00100000:2.0:1784584243.839130:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 63 00000100:00100000:2.0:1784584243.839140:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+16:18788:x1871271580307968:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784584243.839217:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e49afb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.839235:0:22747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8600/0xdab2421a42e49a45 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee97f expref: 16 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.839252:0:22747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e49afb lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.839300:0:22747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8600/0xdab2421a42e49a45 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee97f expref: 16 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.839314:0:22747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8600/0xdab2421a42e49a45 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee97f expref: 16 pid: 22748 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584243.839328:0:22747:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30405d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22747:1871271599270912:192.168.203.51@tcp:104: 00000100:00100000:2.0:1784584243.839997:0:22747:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b40a2d4180 going to sleep for 11 seconds 00000100:00100000:2.0:1784584243.844425:0:22747:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30405d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22747:1871271599270912:192.168.203.51@tcp:104: 00010000:00010000:2.0:1784584243.844454:0:22747:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e49afb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584243.846688:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584243.847732:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580308096 00000100:00100000:2.0:1784584243.847754:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580308096 00010000:00010000:2.0:1784584243.847804:0:22733:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8600/0xdab2421a42e49a45 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee97f expref: 17 pid: 22748 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584243.847848:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00100000:2.0:1784584243.847858:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303853800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+17:2401:x1871271580308096:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784584243.847871:0:22733:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584243.847879:0:22733:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8600/0xdab2421a42e49a45 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee97f expref: 17 pid: 22748 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.847910:0:22733:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8600/0xdab2421a42e49a45 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee97f expref: 17 pid: 22748 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.847935:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b4332b8600/0xdab2421a42e49a45 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee97f expref: 17 pid: 22748 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.847953:0:22733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98b422413600) 00010000:00010000:2.0:1784584243.847959:0:22733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f195c00/0xdab2421a42e49a61 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee98d expref: 16 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.848091:0:22733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e49afb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.848101:0:22733:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e49afb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.848107:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e49afb lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.848140:0:22733:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784584243.848271:0:22747:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e49afb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.848280:0:22747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e49afb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.848535:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49b02 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.848549:0:22747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e49aca lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9a9 expref: 17 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.848558:0:22747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49b02 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.848589:0:22747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e49aca lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9a9 expref: 17 pid: 22747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.848603:0:22747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e49aca lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9a9 expref: 17 pid: 22747 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584243.848617:0:22747:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f283480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22747:1871271599271040:192.168.203.51@tcp:104: 00000100:00100000:2.0:1784584243.848806:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303853800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+17:2401:x1871271580308096:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 947us (2124us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584243.848816:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00100000:2.0:1784584243.849895:0:22747:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b418129c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784584243.853441:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584243.853620:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580308224 00000100:00100000:3.0:1784584243.853629:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580308224 00010000:00010000:3.0:1784584243.853680:0:22734:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e49aca lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9a9 expref: 17 pid: 22747 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584243.853735:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 22 00000100:00100000:3.0:1784584243.853754:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404954000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+17:2401:x1871271580308224:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784584243.853779:0:22734:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584243.853788:0:22734:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e49aca lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9a9 expref: 17 pid: 22747 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.853800:0:22734:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e49aca lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9a9 expref: 17 pid: 22747 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.853821:0:22734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98b303986d00) 00010000:00010000:3.0:1784584243.853826:0:22734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49b02 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.853835:0:22734:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49b02 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.853841:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49b02 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.853859:0:22734:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584243.853908:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404954000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+17:2401:x1871271580308224:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 165us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584243.853915:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 22 00010000:00010000:2.0:1784584243.856697:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8600/0xdab2421a42e49aca lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9a9 expref: 16 pid: 22747 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584243.856719:0:22747:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f283480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22747:1871271599271040:192.168.203.51@tcp:104: 00010000:00010000:2.0:1784584243.856855:0:22747:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49b02 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.856867:0:22747:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49b02 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.856873:0:22747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49b02 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784584243.857040:0:22747:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:2.0:1784584243.858275:0:22747:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000001:00080000:2.0:1784584243.858320:0:22747:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:2.0:1784584243.858915:0:22747:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30405d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22747:1871271599271168:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1784584243.859216:0:22747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584243.859259:0:22747:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b4110bd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784584243.859406:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599271168 00000100:00100000:0.0:1784584243.859427:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599271168 00000100:00100000:0.0:1784584243.859521:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784584243.859530:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22747:x1871271599271168:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784584243.859976:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22747:x1871271599271168:12345-0@lo:1000:mdt00_000.0 Request processed in 437us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584243.859986:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784584243.860207:0:22747:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30405d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22747:1871271599271168:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1784584243.860400:0:22747:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901916 00000100:00100000:3.0:1784584243.860588:0:22747:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f280a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22747:1871271599271296:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784584243.860713:0:22747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584243.860928:0:22747:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b417259480 going to sleep for 11 seconds 00000100:00100000:2.0:1784584243.861089:0:23818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599271296 00000100:00100000:2.0:1784584243.861096:0:23818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599271296 00000100:00100000:2.0:1784584243.861135:0:23818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784584243.861144:0:23818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22747:x1871271599271296:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1784584243.861287:0:23818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22747:x1871271599271296:12345-0@lo:1000:mdt00_000.0 Request processed in 144us (574us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1784584243.861295:0:23818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784584243.861513:0:22747:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f280a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22747:1871271599271296:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1784584243.861552:0:22747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49b02 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.861563:0:22747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49b02 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.861571:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49b02 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.861577:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd8000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784584243.861582:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49b02 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.861590:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49b02 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.861605:0:22747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98b303986d00) 00010000:00010000:3.0:1784584243.861680:0:22747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784584243.861686:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49b02 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.861692:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd8000/0xdab2421a42e49b02 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.861724:0:22747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e49a5a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.861730:0:22747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e49a5a lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.861754:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e49a5a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.861760:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b43ebd9600 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:3.0:1784584243.862156:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e49a5a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.862167:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e49a5a lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.862177:0:22747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98b422413600) 00010000:00010000:3.0:1784584243.862179:0:22747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784584243.862186:0:22747:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f195c00/0xdab2421a42e49a61 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee98d expref: 19 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.862197:0:22747:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f195c00/0xdab2421a42e49a61 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee98d expref: 19 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.862205:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f195c00/0xdab2421a42e49a61 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee98d expref: 19 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.862372:0:22747:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f195c00/0xdab2421a42e49a61 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee98d expref: 19 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584243.862387:0:22747:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30405e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22747:1871271599271424:192.168.203.51@tcp:105: 00000100:00100000:2.0:1784584243.862460:0:22747:0:(client.c:2702:ptlrpc_set_wait()) set ffff98b302b48900 going to sleep for 11 seconds 00000100:00100000:0.0:1784584243.871256:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584243.871556:0:22747:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30405e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22747:1871271599271424:192.168.203.51@tcp:105: 00010000:00010000:2.0:1784584243.871597:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e49a5a lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.871618:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b43ebd9600/0xdab2421a42e49a5a lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.871652:0:22747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49b09 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.871666:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49b09 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.871677:0:22747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49b09 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.871688:0:22747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49b09 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.871695:0:22747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49b09 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.871701:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49b09 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.871707:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1400 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784584243.871711:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49b09 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.871718:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49b09 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.871728:0:22747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98b422413600) 00010000:00010000:2.0:1784584243.871737:0:22747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584243.871741:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49b09 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.871759:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1400/0xdab2421a42e49b09 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.871778:0:22747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e49afb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.871784:0:22747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e49afb lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.871790:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e49afb lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.871795:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1000 already unused, calling callback (ffffffffc1a4a4f0) 00010000:00010000:2.0:1784584243.871798:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e49afb lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.871804:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e49afb lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.871812:0:22747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98b422413600) 00010000:00010000:2.0:1784584243.871814:0:22747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784584243.871817:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e49afb lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.871822:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1000/0xdab2421a42e49afb lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22747 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584243.872003:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580308352 00000100:00100000:3.0:1784584243.872010:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580308352 00000100:00100000:3.0:1784584243.872067:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 10 00000100:00100000:3.0:1784584243.872077:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b406064450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+20:18787:x1871271580308352:12345-192.168.203.51@tcp:49:dd.0 00000100:00100000:3.0:1784584243.872191:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b406064450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+20:18787:x1871271580308352:12345-192.168.203.51@tcp:49:dd.0 Request processed in 115us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584243.872198:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 10 00000100:00100000:2.0:1784584243.872457:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+19:18788:x1871271580307968:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 33318us (33548us total) trans 12884901917 rc 0/0 00000100:00100000:2.0:1784584243.872507:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 63 00000020:00080000:2.0:1784584243.872512:0:22747:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1784584243.876718:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584243.876785:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1784584243.876929:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580308608 00000100:00100000:1.0:1784584243.876939:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580308608 00000100:00100000:1.0:1784584243.877000:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 11 00000100:00100000:1.0:1784584243.877011:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+19:18788:x1871271580308608:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1784584243.877288:0:22751:0:(mdd_object.c:4016:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1784584243.877319:0:22751:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901918 00010000:00010000:1.0:1784584243.877354:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f195600/0xdab2421a42e49b10 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.877370:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f195600/0xdab2421a42e49b10 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.877381:0:22751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f195600/0xdab2421a42e49b10 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.877390:0:22751:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f195600/0xdab2421a42e49b10 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.877396:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f195600/0xdab2421a42e49b10 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.877403:0:22751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f195600/0xdab2421a42e49b10 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.877422:0:22751:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784584243.877537:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+21:18788:x1871271580308608:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 Request processed in 527us (829us total) trans 12884901919 rc 0/0 00000100:00100000:1.0:1784584243.877545:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 11 00000020:00080000:1.0:1784584243.877549:0:22751:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784584243.877580:0:22735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584243.877585:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f195600/0xdab2421a42e49b10 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.877592:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b42f195600 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:1.0:1784584243.877596:0:22735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f195600/0xdab2421a42e49b10 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.877604:0:22735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f195600/0xdab2421a42e49b10 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.877616:0:22735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98b303986d00) 00010000:00010000:1.0:1784584243.877620:0:22735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784584243.877623:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f195600/0xdab2421a42e49b10 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.877629:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b42f195600/0xdab2421a42e49b10 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584243.877640:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584243.877642:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584243.877644:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584243.877779:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580308736 00000100:00100000:2.0:1784584243.877784:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580308736 00000100:00100000:2.0:1784584243.877818:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 64 00000100:00100000:2.0:1784584243.877824:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+21:18787:x1871271580308736:12345-192.168.203.51@tcp:101:dd.0 00010000:00010000:2.0:1784584243.877835:0:23817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584243.877846:0:23817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e49b17 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5ed39ee724ee9c5 expref: -99 pid: 23817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.877871:0:23817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e49b1e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.877879:0:23817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e49b1e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.877887:0:23817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e49b1e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.877961:0:23817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c0a00/0xdab2421a42e49b17 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9c5 expref: 23 pid: 23817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.877975:0:23817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98b3041c1200/0xdab2421a42e49b1e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0xb5ed39ee724ee9c5 expref: 22 pid: 23817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.877983:0:23817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98b422413600) 00010000:00010000:2.0:1784584243.877985:0:23817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784584243.877988:0:23817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98b3041c1200, rc 0) 00000100:00100000:2.0:1784584243.878025:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+22:18787:x1871271580308736:12345-192.168.203.51@tcp:101:dd.0 Request processed in 201us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584243.878031:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 64 00000040:00080000:0.0:1784584243.879323:0:22782:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1784584243.879331:0:22782:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784584243.879358:0:22782:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1784584243.879364:0:22782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1784584243.885589:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784584243.885614:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30405e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599271552:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784584243.885685:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584243.885751:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599271552 00000100:00100000:2.0:1784584243.885759:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599271552 00000100:00100000:2.0:1784584243.885816:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784584243.885826:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599271552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784584243.885862:0:22753:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1784584243.885906:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1871271599271552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584243.885913:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784584243.885959:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30405e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1871271599271552:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784584243.887231:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784584243.887247:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30405e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599271680:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784584243.887303:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584243.887339:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599271680 00000100:00100000:2.0:1784584243.887346:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599271680 00000100:00100000:2.0:1784584243.887383:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784584243.887392:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599271680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784584243.887441:0:22752:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1784584243.887522:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599271680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584243.887529:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784584243.887590:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30405e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599271680:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784584243.908843:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1784584243.908883:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1784584243.909269:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580308864 00000100:00100000:0.0:1784584243.909279:0:24260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580308864 00000100:00100000:0.0:1784584243.909338:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580308992 00000100:00100000:0.0:1784584243.909341:0:24260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580308992 00000100:00100000:0.0:1784584243.909361:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:0.0:1784584243.909370:0:24260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+8:2401:x1871271580308864:12345-192.168.203.51@tcp:4:dd.0 00002000:00010000:0.0:1784584243.909418:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a5e9833, atime: 0x6a5e9832, ctime: 0x6a5e9833, blocks: 0x0 00010000:00010000:0.0:1784584243.909428:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a798332/0xdab2421a42e49b25 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.909444:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=687s v=(0 0) 00010000:00010000:0.0:1784584243.909448:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584243.909455:0:24260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a798332/0xdab2421a42e49b25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584243.909498:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a798332/0xdab2421a42e49b25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784584243.987024:0:25070:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:2.0:1784584243.987043:0:25070:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00002000:00010000:3.0:1784584243.987432:0:24260:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:3.0:1784584243.987437:0:24260:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 1784584243 -> 1784584244 00002000:00010000:3.0:1784584243.987440:0:24260:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1784584243 -> 1784584244 00002000:00010000:3.0:1784584243.987442:0:24260:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:3.0:1784584243.987459:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a798332/0xdab2421a42e49b25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.987512:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a798332/0xdab2421a42e49b25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.987522:0:24260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a798332/0xdab2421a42e49b25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.987530:0:24260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b42f183800 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:3.0:1784584243.987535:0:24260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a798332/0xdab2421a42e49b25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.987544:0:24260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a798332/0xdab2421a42e49b25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.987563:0:24260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a798332/0xdab2421a42e49b25 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584243.987571:0:24260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a798332/0xdab2421a42e49b25 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584243.988056:0:24260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+6:2401:x1871271580308864:12345-192.168.203.51@tcp:4:dd.0 Request processed in 78679us (79215us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1784584243.988072:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:2.0:1784584243.988105:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 1 00000100:00100000:2.0:1784584243.988116:0:24260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b42f280700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+5:2401:x1871271580308992:12345-192.168.203.51@tcp:4:dd.0 00002000:00010000:2.0:1784584243.988160:0:24260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 4194304, mtime: 0x6a5e9834, atime: 0x6a5e9832, ctime: 0x6a5e9834, blocks: 0x2000 00010000:00010000:2.0:1784584243.988167:0:24260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dc45d82/0xdab2421a42e49b2c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.988181:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=687s v=(0 0) 00010000:00010000:2.0:1784584243.988185:0:24260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584243.988192:0:24260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dc45d82/0xdab2421a42e49b2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584243.988204:0:24260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004dc45d82/0xdab2421a42e49b2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784584244.075036:0:25070:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901896 is committed 00002000:00010000:2.0:1784584244.075418:0:24260:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1784584244.075423:0:24260:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1784584244.075438:0:24260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dc45d82/0xdab2421a42e49b2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584244.075452:0:24260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004dc45d82/0xdab2421a42e49b2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584244.075658:0:24260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004dc45d82/0xdab2421a42e49b2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584244.075668:0:24260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98b3041c1400 already unused, calling callback (ffffffffc0e1e230) 00010000:00010000:2.0:1784584244.075674:0:24260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004dc45d82/0xdab2421a42e49b2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584244.075683:0:24260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004dc45d82/0xdab2421a42e49b2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584244.075702:0:24260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004dc45d82/0xdab2421a42e49b2c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584244.075710:0:24260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dc45d82/0xdab2421a42e49b2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584244.075946:0:24260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b42f280700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+5:2401:x1871271580308992:12345-192.168.203.51@tcp:4:dd.0 Request processed in 87830us (167057us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1784584244.075955:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 1 00010000:00010000:1.0:1784584244.206213:0:22736:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584245.232704:0:25088:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584245.339796:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584245.339882:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584245.339918:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584245.339940:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584245.339957:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584245.339975:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584245.340009:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584245.340026:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584245.340056:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1784584245.340083:0:24255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580309632 00000100:00100000:2.0:1784584245.340092:0:24255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580309632 00000100:00100000:2.0:1784584245.340155:0:24255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580310144 00000100:00100000:2.0:1784584245.340158:0:24255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580310144 00000100:00100000:2.0:1784584245.340171:0:24255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580309504 00000100:00100000:2.0:1784584245.340173:0:24255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580309504 00000100:00100000:2.0:1784584245.340184:0:24255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580310016 00000100:00100000:2.0:1784584245.340186:0:24255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580310016 00000100:00100000:2.0:1784584245.340201:0:24255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 14 00000100:00100000:2.0:1784584245.340209:0:24255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4081d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+5:2401:x1871271580309632:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784584245.340287:0:24255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4081d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+5:2401:x1871271580309632:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 78us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584245.340295:0:24255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 14 00000100:00100000:2.0:1784584245.340404:0:24255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 15 00000100:00100000:2.0:1784584245.340411:0:24255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4582ced1-2e60-4215-b04a-25e91daf3166+5:2401:x1871271580310144:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784584245.340435:0:24255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4582ced1-2e60-4215-b04a-25e91daf3166+5:2401:x1871271580310144:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 25us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584245.340442:0:24255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 15 00000100:00100000:2.0:1784584245.340456:0:24255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:2.0:1784584245.340463:0:24255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+5:2401:x1871271580309504:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784584245.340512:0:24255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+5:2401:x1871271580309504:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 50us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584245.340519:0:24255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:2.0:1784584245.340540:0:24255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:2.0:1784584245.340546:0:24255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4582ced1-2e60-4215-b04a-25e91daf3166+5:2401:x1871271580310016:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784584245.340572:0:24255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4582ced1-2e60-4215-b04a-25e91daf3166+5:2401:x1871271580310016:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 26us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584245.340577:0:24255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:2.0:1784584245.340596:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580309376 00000100:00100000:2.0:1784584245.342235:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580309376 00000100:00100000:2.0:1784584245.342301:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580309888 00000100:00100000:2.0:1784584245.342304:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580309888 00000100:00100000:2.0:1784584245.342318:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580309248 00000100:00100000:2.0:1784584245.342320:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580309248 00000100:00100000:2.0:1784584245.342331:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580309760 00000100:00100000:2.0:1784584245.342333:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580309760 00000100:00100000:2.0:1784584245.342349:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 50 00000100:00100000:2.0:1784584245.342356:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+5:2401:x1871271580309376:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784584245.342411:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+5:2401:x1871271580309376:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 55us (2528us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584245.342417:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 50 00000100:00100000:2.0:1784584245.342432:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 51 00000100:00100000:2.0:1784584245.342438:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4582ced1-2e60-4215-b04a-25e91daf3166+5:2401:x1871271580309888:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784584245.342462:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4582ced1-2e60-4215-b04a-25e91daf3166+5:2401:x1871271580309888:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 24us (2522us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584245.342484:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 51 00000100:00100000:2.0:1784584245.342496:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 52 00000100:00100000:2.0:1784584245.342502:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+22:2401:x1871271580309248:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784584245.342536:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:341d21c5-fdb2-43c1-8bba-09bf4a7f7165+22:2401:x1871271580309248:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 34us (2560us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584245.342552:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 52 00000100:00100000:2.0:1784584245.342565:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 53 00000100:00100000:2.0:1784584245.342571:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4582ced1-2e60-4215-b04a-25e91daf3166+6:2401:x1871271580309760:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1784584245.342597:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4582ced1-2e60-4215-b04a-25e91daf3166+6:2401:x1871271580309760:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 27us (2570us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584245.342947:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 53 00000100:00080000:2.0:1784584245.342980:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784584245.342984:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784584245.342987:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784584245.342989:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784584245.347168:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271580309120 00000100:00100000:0.0:1784584245.347187:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271580309120 00000100:00100000:0.0:1784584245.347267:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 165 00000100:00100000:0.0:1784584245.347277:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42c9664f-6d9c-42f4-930b-fd8093c44492+13:2401:x1871271580309120:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1784584245.347356:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42c9664f-6d9c-42f4-930b-fd8093c44492+13:2401:x1871271580309120:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 79us (7567us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584245.347363:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 165 00000001:02000400:0.0:1784584245.607392:0:25832:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:0.0:1784584245.933866:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599271936:0@lo:400:kworker.0 00000100:00100000:3.0:1784584245.933891:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:954867da-9a7c-4a17-b608-74c1de1cda93:3642:1871271599271808:0@lo:400:kworker.0 00000100:00100000:1.0:1784584245.933991:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f282680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599272192:0@lo:400:kworker.0 00000100:00100000:2.0:1784584245.934076:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b404957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599272064:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784584245.935950:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584245.935999:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584245.936002:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599272320:0@lo:400:kworker.0 00000100:00100000:2.0:1784584245.936041:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599272576:0@lo:400:kworker.0 00000100:00100000:3.0:1784584245.937221:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584245.937272:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599272832:0@lo:400:kworker.0 00000100:00100000:3.0:1784584245.937298:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584245.937316:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1871271599273344:0@lo:400:kworker.0 00000100:00100000:3.0:1784584245.940284:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584245.940342:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784584245.940438:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b30405ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599273728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784584245.940497:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584245.940542:0:24255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599272320 00000100:00100000:3.0:1784584245.940550:0:24255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599272320 00000100:00100000:3.0:1784584245.940930:0:24255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599272832 00000100:00100000:3.0:1784584245.940935:0:24255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599272832 00000100:00100000:3.0:1784584245.940962:0:24255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784584245.940971:0:24255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599272320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584245.941028:0:24255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599272320:12345-0@lo:400:kworker.0 Request processed in 58us (3809us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584245.941035:0:24255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784584245.941050:0:24255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784584245.941056:0:24255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599272832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584245.941083:0:24255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871271599272832:12345-0@lo:400:kworker.0 Request processed in 27us (3783us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584245.941106:0:24255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784584245.941129:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599273344 00000100:00100000:3.0:1784584245.941133:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599273344 00000100:00100000:3.0:1784584245.941162:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784584245.941168:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871271599273344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584245.941201:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871271599273344:12345-0@lo:400:kworker.0 Request processed in 32us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584245.941207:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784584245.941224:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599272064 00000100:00100000:3.0:1784584245.941227:0:24258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599272064 00000100:00100000:3.0:1784584245.941242:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599273728 00000100:00100000:3.0:1784584245.941244:0:24258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599273728 00000100:00100000:3.0:1784584245.941276:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784584245.941281:0:24258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599272064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784584245.941301:0:24258:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3908202496 avail 3676680192 00000100:00100000:3.0:1784584245.941336:0:24258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599272064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (5336us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584245.941354:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784584245.941367:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784584245.941372:0:24258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b43766f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599273728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784584245.941388:0:24258:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1784584245.941415:0:24258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b43766f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871271599273728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584245.941421:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784584245.941500:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b30405ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599273728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784584245.941513:0:3642:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:3.0:1784584245.941525:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98b43766ea00, transno 12884901892 00000004:00080000:3.0:1784584245.941538:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:3.0:1784584245.941560:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1871271599272320:0@lo:400:kworker.0 00000100:00100000:3.0:1784584245.941574:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1871271599272832:0@lo:400:kworker.0 00000100:00100000:3.0:1784584245.942382:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1871271599273344:0@lo:400:kworker.0 00000100:00080000:3.0:1784584245.942564:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784584245.942569:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784584245.942571:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784584245.942846:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584245.942882:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599271808 00000100:00100000:0.0:1784584245.942888:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599272448:0@lo:400:kworker.0 00000100:00100000:3.0:1784584245.942889:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599271808 00000100:00100000:0.0:1784584245.942935:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584245.942939:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1784584245.942949:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b430f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+24:3642:x1871271599271808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584245.942962:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599272960:0@lo:400:kworker.0 00000100:00100000:0.0:1784584245.942996:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584245.943011:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b430f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:954867da-9a7c-4a17-b608-74c1de1cda93+24:3642:x1871271599271808:12345-0@lo:400:kworker.0 Request processed in 63us (7066us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584245.943020:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1784584245.943060:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:954867da-9a7c-4a17-b608-74c1de1cda93:3642:1871271599271808:0@lo:400:kworker.0 00000100:00100000:3.0:1784584245.943088:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599272448 00000100:00100000:3.0:1784584245.943092:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599272448 00000100:00100000:0.0:1784584245.943096:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1871271599273472:0@lo:400:kworker.0 00000100:00100000:3.0:1784584245.943118:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599272960 00000100:00100000:3.0:1784584245.943122:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599272960 00000100:00100000:0.0:1784584245.943127:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584245.943143:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599273472 00000100:00100000:3.0:1784584245.943147:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599273472 00000100:00100000:0.0:1784584245.943180:0:23818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599271936 00000100:00100000:3.0:1784584245.943186:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784584245.943187:0:23818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599271936 00000100:00100000:3.0:1784584245.943195:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599272448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584245.943222:0:23818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784584245.943231:0:23818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599271936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584245.943243:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871271599272448:12345-0@lo:400:kworker.0 Request processed in 49us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584245.943262:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784584245.943281:0:23818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1871271599271936:12345-0@lo:400:kworker.0 Request processed in 50us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584245.943293:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784584245.943308:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b404957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599272960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584245.943308:0:23818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784584245.943341:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784584245.943349:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b4105f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1871271599273472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584245.945565:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b404957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871271599272960:12345-0@lo:400:kworker.0 Request processed in 2253us (2558us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584245.945575:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b4105f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1871271599273472:12345-0@lo:400:kworker.0 Request processed in 2225us (2448us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584245.945588:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784584245.945654:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871271599272960:0@lo:400:kworker.0 00010000:00080000:0.0:1784584245.945670:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303bc1c00 x1871271599273472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584245.945681:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1871271599273472:0@lo:400:kworker.0 00000100:00100000:0.0:1784584245.945693:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1871271599271936:0@lo:400:kworker.0 00000100:00100000:0.0:1784584245.945705:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871271599272448:0@lo:400:kworker.0 00000100:00100000:3.0:1784584245.945821:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1784584245.945848:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784584245.949286:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584245.949339:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599273088:0@lo:400:kworker.0 00000100:00100000:2.0:1784584245.949379:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584245.949407:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599273600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784584245.949433:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584245.949444:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599272576 00000100:00100000:3.0:1784584245.949453:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599272576 00000100:00100000:2.0:1784584245.949461:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599273600 00000100:00100000:2.0:1784584245.949484:0:24258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599273600 00000100:00100000:3.0:1784584245.949522:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784584245.949524:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784584245.949539:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599272576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584245.949539:0:24258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599273600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784584245.949567:0:24258:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3908202496 avail 3676680192 00000100:00100000:2.0:1784584245.949600:0:24258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871271599273600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584245.949618:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784584245.949667:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1871271599273600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784584245.949699:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b404957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599272064:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784584245.949842:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871271599272576:12345-0@lo:400:kworker.0 Request processed in 309us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584245.949849:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784584245.950863:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599273088 00000100:00100000:0.0:1784584245.950872:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599273088 00000100:00080000:3.0:1784584245.950932:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784584245.950942:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784584245.950953:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b30405dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599273088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584245.951086:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b30405dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871271599273088:12345-0@lo:400:kworker.0 Request processed in 135us (1705us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584245.951093:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784584245.951194:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584245.951220:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b42f281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599272704:0@lo:400:kworker.0 00000100:00100000:1.0:1784584245.951245:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584245.951279:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98b303bc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599273216:0@lo:400:kworker.0 00000100:00100000:1.0:1784584245.951298:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584245.951331:0:23817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599273216 00000100:00100000:1.0:1784584245.951334:0:23817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599273216 00000100:00100000:1.0:1784584245.951366:0:23817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784584245.951373:0:23817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599273216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584245.951404:0:23817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871271599273216:12345-0@lo:400:kworker.0 Request processed in 31us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584245.951410:0:23817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1784584245.951424:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1784584245.951447:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98b303bc2300 x1871271599273216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584245.951461:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1871271599273216:0@lo:400:kworker.0 00000100:00100000:0.0:1784584245.951544:0:24895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599272192 00000100:00100000:0.0:1784584245.951548:0:24895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599272192 00000100:00100000:0.0:1784584245.951576:0:24895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871271599272704 00000100:00100000:0.0:1784584245.951579:0:24895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871271599272704 00000100:00100000:0.0:1784584245.951606:0:24895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784584245.951620:0:24895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303852680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599272192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584245.951653:0:24895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303852680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1871271599272192:12345-0@lo:400:kworker.0 Request processed in 35us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584245.951659:0:24895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784584245.951669:0:24895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784584245.951675:0:24895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98b303851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599272704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584245.951697:0:24895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98b303851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1871271599272704:12345-0@lo:400:kworker.0 Request processed in 23us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584245.951703:0:24895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1784584245.951718:0:22743:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784584245.951903:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f282680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1871271599272192:0@lo:400:kworker.0 00000100:00100000:1.0:1784584245.951913:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1871271599272704:0@lo:400:kworker.0 00000100:00100000:2.0:1784584245.952123:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b42f281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1871271599272576:0@lo:400:kworker.0 00000100:00100000:2.0:1784584245.952134:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98b303bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1871271599273088:0@lo:400:kworker.0 00010000:00010000:1.0:1784584246.253941:0:22735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 13783 lines, 13783 kept, 0 dropped, 0 bad.