00000001:00080000:0.0F:1788748540.202056:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:0.0:1788748540.202093:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99cec8a0e300 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:0.0:1788748540.202099:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99cec959ba00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99cec8a0e600 00000020:00080000:0.0:1788748540.202102:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99cec959b200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99cdc53d2400 00000020:00080000:0.0:1788748540.202132:0:14357:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:0.0:1788748540.202329:0:14357:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0F:1788748540.526978:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748541.165975:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788748541.165995:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377095680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788748541.166086:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0F:1788748541.166448:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377095680 00000100:00100000:1.0:1788748541.166469:0:15009:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377095680 00000100:00100000:1.0:1788748541.166538:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788748541.166548:0:15009:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377095680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788748541.166580:0:15009:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788748541.166638:0:15009:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377095680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748541.166646:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788748541.167938:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788748541.167990:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377095680:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788748541.560245:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0F:1788748541.682870:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7307480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9f57890-027b-4d36-a4ce-36a41fae69fb:3308:1875638377095808:0@lo:400:kworker.0 00000100:00100000:2.0:1788748541.682955:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748541.683041:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875638377096320:0@lo:400:kworker.0 00000100:00100000:2.0:1788748541.683071:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748541.683103:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748541.683109:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377095936:0@lo:400:kworker.0 00000100:00100000:2.0:1788748541.683131:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748541.683163:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7305180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377096064:0@lo:400:kworker.0 00000100:00100000:2.0:1788748541.683186:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748541.683205:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788748541.683211:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7304e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875638377096192:0@lo:400:kworker.0 00000100:00100000:2.0:1788748541.683229:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748541.683260:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377095808 00000100:00100000:2.0:1788748541.683268:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377095808 00000100:00100000:2.0:1788748541.683312:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788748541.683661:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:3308:x1875638377095808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748541.683719:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:3308:x1875638377095808:12345-0@lo:400:kworker.0 Request processed in 398us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748541.683727:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788748541.683758:0:16300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377096320 00000100:00100000:2.0:1788748541.683761:0:16300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377096320 00000100:00100000:2.0:1788748541.683792:0:16300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377096064 00000100:00100000:2.0:1788748541.683795:0:16300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377096064 00000100:00100000:2.0:1788748541.683809:0:16300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377096192 00000100:00100000:2.0:1788748541.683811:0:16300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377096192 00000100:00100000:2.0:1788748541.683824:0:16300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788748541.683829:0:16300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875638377096320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748541.683857:0:16300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875638377096320:12345-0@lo:400:kworker.0 Request processed in 28us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748541.683871:0:16300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788748541.683885:0:16300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788748541.683890:0:16300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377096064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748541.683921:0:16300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377096064:12345-0@lo:400:kworker.0 Request processed in 31us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748541.683927:0:16300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788748541.683937:0:16300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788748541.683943:0:16300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875638377096192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748541.683970:0:16300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875638377096192:12345-0@lo:400:kworker.0 Request processed in 27us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748541.683975:0:16300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788748541.683991:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377095936 00000100:00100000:2.0:1788748541.683995:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377095936 00000100:00100000:2.0:1788748541.684049:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788748541.684057:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377095936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748541.684087:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377095936:12345-0@lo:400:kworker.0 Request processed in 32us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748541.684094:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788748541.684188:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377095936:0@lo:400:kworker.0 00000100:00100000:2.0:1788748541.684198:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7307480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9f57890-027b-4d36-a4ce-36a41fae69fb:3308:1875638377095808:0@lo:400:kworker.0 00000100:00100000:2.0:1788748541.684207:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875638377096320:0@lo:400:kworker.0 00000100:00080000:2.0:1788748541.684231:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788748541.684235:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748541.684258:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7304e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875638377096192:0@lo:400:kworker.0 00000100:00100000:2.0:1788748541.684276:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7305180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377096064:0@lo:400:kworker.0 00000100:00100000:2.0:1788748541.689266:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377096448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788748541.689451:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748541.689521:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377096448 00000100:00100000:2.0:1788748541.689530:0:15009:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377096448 00000100:00100000:2.0:1788748541.689575:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788748541.689585:0:15009:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377096448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788748541.689619:0:15009:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788748541.689661:0:15009:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377096448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748541.689667:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788748541.689708:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377096448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788748542.252711:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748542.253167:0:16300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358242560 00000100:00100000:2.0:1788748542.253178:0:16300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358242560 00000100:00100000:2.0:1788748542.253252:0:16300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 54 00000100:00100000:2.0:1788748542.253263:0:16300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+12:14393:x1875638358242560:12345-192.168.203.4@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788748542.253368:0:16300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+12:14393:x1875638358242560:12345-192.168.203.4@tcp:60:lhsmtool_posix.0 Request processed in 108us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748542.253376:0:16300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 54 00000100:00080000:0.0:1788748542.256225:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748542.257439:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748542.257932:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358242816 00000100:00100000:0.0:1788748542.257943:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358242816 00000100:00100000:0.0:1788748542.258049:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:0.0:1788748542.258062:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+12:14393:x1875638358242816:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788748542.259046:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+13:14393:x1875638358242816:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 952us (1577us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1788748542.259057:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12 00000040:00080000:3.0:1788748542.317867:0:14351:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788748542.317876:0:14351:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788748542.317905:0:14351:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788748542.317910:0:14351:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788748542.573518:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748543.532522:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748543.532574:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748543.532606:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358242944 00000100:00100000:1.0:1788748543.532615:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358242944 00000100:00100000:1.0:1788748543.532673:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 125 00000100:00100000:1.0:1788748543.532685:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78d8312a-c6be-424c-9507-3b6e26d87fc6+13:2348:x1875638358242944:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748543.532744:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:78d8312a-c6be-424c-9507-3b6e26d87fc6+13:2348:x1875638358242944:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 63us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748543.532752:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 125 00000100:00100000:1.0:1788748543.532786:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358243072 00000100:00100000:1.0:1788748543.532789:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358243072 00000100:00100000:1.0:1788748543.532815:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:1.0:1788748543.532821:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+13:2348:x1875638358243072:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748543.532848:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+13:2348:x1875638358243072:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 27us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748543.532854:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:1.0:1788748543.536974:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748543.537068:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748543.537091:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748543.537113:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748543.537139:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748543.537166:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358243200 00000100:00100000:1.0:1788748543.537177:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358243200 00000100:00100000:1.0:1788748543.537224:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358243584 00000100:00100000:1.0:1788748543.537227:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358243584 00000100:00100000:1.0:1788748543.537241:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358243712 00000100:00100000:1.0:1788748543.537244:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358243712 00000100:00100000:0.0:1788748543.537332:0:15495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358243328 00000100:00100000:0.0:1788748543.537336:0:15495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358243328 00000100:00100000:0.0:1788748543.537359:0:15495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:0.0:1788748543.537369:0:15495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+5:2347:x1875638358243328:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748543.537453:0:15495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+5:2347:x1875638358243328:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 85us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748543.537471:0:15495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:0.0:1788748543.537506:0:15495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:0.0:1788748543.537513:0:15495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+5:2346:x1875638358243200:12345-192.168.203.4@tcp:9:kworker.0 00000020:00000080:0.0:1788748543.537534:0:15495:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7d323 00000100:00080000:0.0:1788748543.537548:0:15495:0:(import.c:65:import_set_state_nolock()) ffff99cee517c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788748543.537590:0:15495:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1788748543.537847:0:15495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+2:2346:x1875638358243200:12345-192.168.203.4@tcp:9:kworker.0 Request processed in 333us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748543.537855:0:15495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:0.0:1788748543.537874:0:15495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:0.0:1788748543.537883:0:15495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb271f1b-92e5-4fbb-963b-7b6519557c0b+5:2346:x1875638358243584:12345-192.168.203.4@tcp:9:kworker.0 00000020:00000080:0.0:1788748543.537899:0:15495:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7d35b 00000100:00080000:0.0:1788748543.537905:0:15495:0:(import.c:65:import_set_state_nolock()) ffff99cefd3ce000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788748543.537929:0:15495:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1788748543.538058:0:15495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb271f1b-92e5-4fbb-963b-7b6519557c0b+2:2346:x1875638358243584:12345-192.168.203.4@tcp:9:kworker.0 Request processed in 175us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748543.538066:0:15495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00010000:00010000:0.0:1788748543.538085:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748543.538314:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:1.0:1788748543.538323:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb271f1b-92e5-4fbb-963b-7b6519557c0b+5:2346:x1875638358243712:12345-192.168.203.4@tcp:9:kworker.0 00000020:00000080:1.0:1788748543.538336:0:15006:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7d362 00000100:00080000:1.0:1788748543.538346:0:15006:0:(import.c:65:import_set_state_nolock()) ffff99cee517e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788748543.538373:0:15006:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:1.0:1788748543.538574:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb271f1b-92e5-4fbb-963b-7b6519557c0b+2:2346:x1875638358243712:12345-192.168.203.4@tcp:9:kworker.0 Request processed in 252us (1480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748543.538583:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:1.0:1788748543.538607:0:15949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358243456 00000100:00100000:1.0:1788748543.538612:0:15949:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358243456 00000100:00100000:1.0:1788748543.538645:0:15949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:1.0:1788748543.538652:0:15949:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb271f1b-92e5-4fbb-963b-7b6519557c0b+6:2347:x1875638358243456:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748543.538682:0:15949:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb271f1b-92e5-4fbb-963b-7b6519557c0b+6:2347:x1875638358243456:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 31us (1568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748543.538689:0:15949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00080000:1.0:1788748543.538711:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788748543.538716:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788748543.538719:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788748543.538871:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748543.538897:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748543.598225:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748544.621162:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788748545.341435:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:1.0:1788748545.341449:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:1.0:1788748545.341473:0:14357:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:1.0:1788748545.341483:0:14357:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00010000:00010000:2.0:1788748545.651165:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748546.294597:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7304e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377096576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788748546.294709:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748546.294811:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377096576 00000100:00100000:1.0:1788748546.294820:0:15009:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377096576 00000100:00100000:1.0:1788748546.294880:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788748546.294890:0:15009:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377096576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788748546.294922:0:15009:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788748546.296083:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788748546.299514:0:15009:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377096576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4616us (4796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748546.299529:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788748546.300447:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7304e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377096576:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1788748546.340694:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of eb271f1b-92e5-4fbb-963b-7b6519557c0b 00000020:00000080:1.0:1788748546.340704:0:7648:0:(genops.c:885:class_export_put()) final put ffff99cee517f000/eb271f1b-92e5-4fbb-963b-7b6519557c0b 00000020:00000080:1.0:1788748546.340731:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99cee517f000/eb271f1b-92e5-4fbb-963b-7b6519557c0b for lustre-OST0001 00000020:00000080:1.0:1788748546.340773:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cee517e800 for lustre-OST0001 00010000:00010000:3.0:1788748546.670847:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748546.797390:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9f57890-027b-4d36-a4ce-36a41fae69fb:3307:1875638377096704:0@lo:400:kworker.0 00000100:00100000:3.0:1788748546.797477:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748546.797510:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377096832:0@lo:400:kworker.0 00000100:00100000:3.0:1788748546.797530:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875638377097216:0@lo:400:kworker.0 00000100:00100000:3.0:1788748546.797566:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748546.797576:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748546.797617:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788748546.797618:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788748546.797626:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875638377097088:0@lo:400:kworker.0 00000100:00100000:2.0:1788748546.797636:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875638377096960:0@lo:400:kworker.0 00000100:00100000:3.0:1788748546.797658:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748546.798892:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377096832 00000100:00100000:1.0:1788748546.798900:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377096832 00000100:00100000:1.0:1788748546.798960:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788748546.798970:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced1d19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377096832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748546.799059:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced1d19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377096832:12345-0@lo:400:kworker.0 Request processed in 90us (1483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748546.799065:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788748546.799601:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377096704 00000100:00100000:3.0:1788748546.799608:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377096704 00000100:00100000:3.0:1788748546.799642:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788748546.799649:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd785850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:3307:x1875638377096704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748546.799696:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd785850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:3307:x1875638377096704:12345-0@lo:400:kworker.0 Request processed in 47us (2220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748546.799702:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788748546.799738:0:16300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377097216 00000100:00100000:3.0:1788748546.799742:0:16300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377097216 00000100:00100000:3.0:1788748546.799777:0:16300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377097088 00000100:00100000:3.0:1788748546.799780:0:16300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377097088 00000100:00100000:3.0:1788748546.799801:0:16300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788748546.799807:0:16300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875638377097216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748546.799848:0:16300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875638377097216:12345-0@lo:400:kworker.0 Request processed in 41us (2282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748546.799854:0:16300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788748546.799867:0:16300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788748546.799873:0:16300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875638377097088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748546.799898:0:16300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875638377097088:12345-0@lo:400:kworker.0 Request processed in 26us (2241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748546.799903:0:16300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788748546.799925:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748546.799995:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377096832:0@lo:400:kworker.0 00000100:00100000:3.0:1788748546.800037:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377097344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748546.800064:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788748546.800095:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788748546.800100:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788748546.800112:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377096960 00000100:00100000:3.0:1788748546.800115:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377096960 00000100:00100000:3.0:1788748546.800135:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788748546.800141:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875638377096960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748546.800175:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875638377096960:12345-0@lo:400:kworker.0 Request processed in 34us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748546.800193:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788748546.800217:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377097344 00000100:00100000:3.0:1788748546.800221:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377097344 00000100:00100000:3.0:1788748546.800245:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788748546.800251:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377097344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788748546.800299:0:15008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 59572224 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788748546.800337:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377097344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748546.800344:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788748546.800379:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377097344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748546.800389:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875638377096960:0@lo:400:kworker.0 00000100:00100000:3.0:1788748546.800416:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875638377097088:0@lo:400:kworker.0 00000100:00100000:3.0:1788748546.800424:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9f57890-027b-4d36-a4ce-36a41fae69fb:3307:1875638377096704:0@lo:400:kworker.0 00000100:00100000:3.0:1788748546.800434:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875638377097216:0@lo:400:kworker.0 00000001:00100000:1.0:1788748546.857939:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of eb271f1b-92e5-4fbb-963b-7b6519557c0b 00000020:00000080:1.0:1788748546.857948:0:6723:0:(genops.c:885:class_export_put()) final put ffff99cec44c8800/eb271f1b-92e5-4fbb-963b-7b6519557c0b 00000001:00100000:1.0:1788748546.857976:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 58c964ac-5e91-4166-9f7a-7c26cfcbe23d 00000020:00000080:1.0:1788748546.857979:0:6723:0:(genops.c:885:class_export_put()) final put ffff99cee517e000/58c964ac-5e91-4166-9f7a-7c26cfcbe23d 00000020:00000080:1.0:1788748546.858010:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cec44c8800/eb271f1b-92e5-4fbb-963b-7b6519557c0b for lustre-OST0000 00000020:00000080:1.0:1788748546.858085:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cee517e000/58c964ac-5e91-4166-9f7a-7c26cfcbe23d for lustre-OST0000 00000020:00000080:1.0:1788748546.858107:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cefd3ce000 for lustre-OST0000 00000020:00000080:1.0:1788748546.858113:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cee517c800 for lustre-OST0000 00010000:00010000:1.0:1788748547.694819:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748548.645203:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748548.645233:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748548.645261:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748548.645293:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748548.645330:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358243968 00000100:00100000:1.0:1788748548.645339:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358243968 00000100:00100000:1.0:1788748548.645411:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358244224 00000100:00100000:1.0:1788748548.645415:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358244224 00000100:00100000:1.0:1788748548.645439:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:1.0:1788748548.645458:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+12:2348:x1875638358243968:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748548.645528:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+12:2348:x1875638358243968:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 71us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748548.645535:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:1.0:1788748548.645553:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:1.0:1788748548.645559:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb271f1b-92e5-4fbb-963b-7b6519557c0b+6:2348:x1875638358244224:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748548.645582:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb271f1b-92e5-4fbb-963b-7b6519557c0b+6:2348:x1875638358244224:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748548.645587:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00080000:1.0:1788748548.645601:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748548.645903:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358243840 00000100:00100000:2.0:1788748548.645908:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358243840 00000100:00100000:2.0:1788748548.645947:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 127 00000100:00100000:2.0:1788748548.645955:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+13:2348:x1875638358243840:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748548.646005:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+13:2348:x1875638358243840:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 51us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748548.646038:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 127 00000100:00100000:3.0:1788748548.646224:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358244096 00000100:00100000:3.0:1788748548.646228:0:15005:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358244096 00000100:00100000:3.0:1788748548.646282:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:3.0:1788748548.646289:0:15005:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+5:2348:x1875638358244096:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748548.646316:0:15005:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+5:2348:x1875638358244096:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 28us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748548.646321:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00080000:2.0:1788748548.646407:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788748548.726304:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748549.744882:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788748550.572402:0:17263:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 22:35:48 (1788748548) 00010000:00010000:1.0:1788748550.769131:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748551.415566:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748551.415829:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377097472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788748551.421011:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748551.426169:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377097472 00000100:00100000:0.0:1788748551.426185:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377097472 00000100:00100000:2.0:1788748551.430523:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788748551.430537:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377097472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788748551.430574:0:15008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788748551.430660:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377097472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (9656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748551.430667:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788748551.430720:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377097472:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788748551.432613:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788748551.790483:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748551.920772:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377097856:0@lo:400:kworker.0 00000100:00100000:2.0:1788748551.920854:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748551.920918:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748551.920925:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7307800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875638377097984:0@lo:400:kworker.0 00000100:00100000:2.0:1788748551.920964:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748551.922074:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377097600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748551.922122:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748551.922164:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7306a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875638377098112:0@lo:400:kworker.0 00000100:00100000:3.0:1788748551.922186:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748551.922210:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788748551.922216:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7307480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9f57890-027b-4d36-a4ce-36a41fae69fb:3306:1875638377097728:0@lo:400:kworker.0 00000100:00100000:3.0:1788748551.922240:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748551.922289:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7306680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377098240:0@lo:400:kworker.0 00000100:00100000:3.0:1788748551.922312:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748551.922348:0:16300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377097984 00000100:00100000:3.0:1788748551.922356:0:16300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377097984 00000100:00100000:3.0:1788748551.922396:0:16300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377098112 00000100:00100000:3.0:1788748551.922399:0:16300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377098112 00000100:00100000:3.0:1788748551.922436:0:16300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377098240 00000100:00100000:3.0:1788748551.922439:0:16300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377098240 00000100:00100000:3.0:1788748551.922765:0:16300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788748551.922774:0:16300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875638377097984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748551.922835:0:16300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875638377097984:12345-0@lo:400:kworker.0 Request processed in 62us (1869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748551.922842:0:16300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788748551.922862:0:16300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788748551.922871:0:16300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875638377098112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748551.922898:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7307800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875638377097984:0@lo:400:kworker.0 00000100:00100000:3.0:1788748551.922907:0:16300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875638377098112:12345-0@lo:400:kworker.0 Request processed in 37us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748551.922914:0:16300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788748551.922929:0:16300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788748551.922937:0:16300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377098240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748551.922975:0:16300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377098240:12345-0@lo:400:kworker.0 Request processed in 40us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748551.922981:0:16300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788748551.923001:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377097728 00000100:00100000:3.0:1788748551.923004:0:14310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377097728 00000100:00100000:1.0:1788748551.923090:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377097856 00000100:00100000:1.0:1788748551.923095:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377097856 00000100:00100000:1.0:1788748551.923122:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788748551.923128:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377097856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748551.923162:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377097856:12345-0@lo:400:kworker.0 Request processed in 35us (2309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748551.923168:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788748551.923194:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377097856:0@lo:400:kworker.0 00000100:00100000:2.0:1788748551.923330:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377097600 00000100:00100000:2.0:1788748551.923341:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377097600 00000100:00100000:2.0:1788748551.923373:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788748551.923380:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377097600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788748551.923405:0:15008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 59572224 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788748551.923552:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377097600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 173us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748551.923559:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788748551.923700:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788748551.923706:0:14310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceed55c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:3306:x1875638377097728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748551.923742:0:14310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceed55c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:3306:x1875638377097728:12345-0@lo:400:kworker.0 Request processed in 36us (1501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748551.923748:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:3.0:1788748551.923769:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788748551.923773:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748551.923790:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7307480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9f57890-027b-4d36-a4ce-36a41fae69fb:3306:1875638377097728:0@lo:400:kworker.0 00000100:00100000:3.0:1788748551.923800:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7306680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377098240:0@lo:400:kworker.0 00000100:00100000:3.0:1788748551.923814:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377097600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748551.923824:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7306a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875638377098112:0@lo:400:kworker.0 00000040:00080000:0.0:1788748552.561236:0:14351:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788748552.561245:0:14351:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788748552.561275:0:14351:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788748552.561291:0:14351:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788748552.816430:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748553.766996:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748553.767074:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748553.767108:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748553.767138:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748553.767179:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358244608 00000100:00100000:1.0:1788748553.767191:0:15005:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358244608 00000100:00100000:1.0:1788748553.767261:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:1.0:1788748553.767273:0:15005:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+5:2350:x1875638358244608:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748553.767498:0:16300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358244480 00000100:00100000:3.0:1788748553.767503:0:16300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358244480 00000100:00100000:3.0:1788748553.767540:0:16300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358244736 00000100:00100000:3.0:1788748553.767543:0:16300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358244736 00000100:00100000:3.0:1788748553.767566:0:16300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:3.0:1788748553.767573:0:16300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+12:2350:x1875638358244480:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748553.767619:0:16300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+12:2350:x1875638358244480:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 45us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748553.767627:0:16300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:3.0:1788748553.767652:0:16300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:3.0:1788748553.767658:0:16300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb271f1b-92e5-4fbb-963b-7b6519557c0b+6:2350:x1875638358244736:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748553.767683:0:16300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb271f1b-92e5-4fbb-963b-7b6519557c0b+6:2350:x1875638358244736:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 25us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748553.767688:0:16300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00080000:3.0:1788748553.767758:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788748553.767764:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788748553.768255:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358244352 00000100:00100000:0.0:1788748553.768262:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358244352 00000100:00100000:1.0:1788748553.768793:0:15005:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+5:2350:x1875638358244608:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 1516us (1645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748553.768806:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:0.0:1788748553.770841:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 129 00000100:00100000:0.0:1788748553.770865:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec3ca8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78d8312a-c6be-424c-9507-3b6e26d87fc6+13:2350:x1875638358244352:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748553.770992:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec3ca8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:78d8312a-c6be-424c-9507-3b6e26d87fc6+13:2350:x1875638358244352:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 134us (3878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748553.771000:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 129 00010000:00010000:1.0:1788748553.837223:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748554.060986:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748554.062868:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358244992 00000100:00100000:0.0:1788748554.062891:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358244992 00000100:00100000:0.0:1788748554.063009:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:0.0:1788748554.063038:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+12:15269:x1875638358244992:12345-192.168.203.4@tcp:35:umount.0 00000001:00080000:0.0:1788748554.063461:0:14321:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1788748554.063759:0:14321:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:0.0:1788748554.063942:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+15:15269:x1875638358244992:12345-192.168.203.4@tcp:35:umount.0 Request processed in 896us (2959us total) trans 8589934626 rc 0/0 00000100:00100000:0.0:1788748554.063952:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00000020:00080000:0.0:1788748554.063958:0:14321:0:(tgt_main.c:545:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788748554.070486:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748554.070551:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748554.070584:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748554.071400:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748554.071412:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358245120 00000100:00100000:1.0:1788748554.071427:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358245120 00000100:00100000:2.0:1788748554.071462:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358245504 00000100:00100000:2.0:1788748554.071468:0:15006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358245504 00000100:00100000:1.0:1788748554.071501:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358245376 00000100:00100000:1.0:1788748554.071506:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358245376 00000100:00100000:2.0:1788748554.071514:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:2.0:1788748554.071528:0:15006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+5:2346:x1875638358245504:12345-192.168.203.4@tcp:9:umount.0 00000100:00100000:1.0:1788748554.071545:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358245248 00000100:00100000:1.0:1788748554.071550:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358245248 00000100:00100000:1.0:1788748554.071569:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:1.0:1788748554.071578:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7306a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78d8312a-c6be-424c-9507-3b6e26d87fc6+15:2349:x1875638358245120:12345-192.168.203.4@tcp:103:ldlm_bl.0 00000020:00000080:2.0:1788748554.071583:0:15006:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7d32a 00010000:00010000:1.0:1788748554.071593:0:14303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:2.0:1788748554.071612:0:15006:0:(import.c:65:import_set_state_nolock()) ffff99cee5178800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788748554.071620:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cee536f200/0x5b377f42a7a7d307 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219f9 expref: 15 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748554.071642:0:14303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00000004:2.0:1788748554.071668:0:15006:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:1.0:1788748554.071720:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7306a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78d8312a-c6be-424c-9507-3b6e26d87fc6+14:2349:x1875638358245120:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 142us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748554.071728:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:1.0:1788748554.071748:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:1.0:1788748554.071756:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef2b73c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78d8312a-c6be-424c-9507-3b6e26d87fc6+13:2349:x1875638358245376:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748554.071765:0:14303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748554.071776:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ceecec2400/0x5b377f42a7a7d3af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ac4 expref: 13 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748554.071785:0:14303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748554.071808:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef2b73c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78d8312a-c6be-424c-9507-3b6e26d87fc6+12:2349:x1875638358245376:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 53us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748554.071814:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:1.0:1788748554.071879:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:1.0:1788748554.071888:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7306d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78d8312a-c6be-424c-9507-3b6e26d87fc6+11:2349:x1875638358245248:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748554.071897:0:14303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748554.071907:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cee536ea00/0x5b377f42a7a7d30e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521a23 expref: 11 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748554.071926:0:14303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748554.071964:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7306d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78d8312a-c6be-424c-9507-3b6e26d87fc6+10:2349:x1875638358245248:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 78us (1379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748554.071972:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:2.0:1788748554.071999:0:15006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+2:2346:x1875638358245504:12345-192.168.203.4@tcp:9:umount.0 Request processed in 472us (602us total) trans 0 rc 0/0 00010000:00010000:1.0:1788748554.072000:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748554.072011:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:3.0:1788748554.085665:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748554.088146:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358246400 00000100:00100000:0.0:1788748554.088167:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358246400 00000100:00100000:0.0:1788748554.088263:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00100000:0.0:1788748554.088277:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+15:2346:x1875638358246400:12345-192.168.203.4@tcp:39:umount.0 00000020:00000080:0.0:1788748554.088325:0:14319:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7d31c 00000020:00010000:0.0:1788748554.088846:0:14319:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99cef746e800: total 0 00000100:00080000:0.0:1788748554.088854:0:14319:0:(import.c:65:import_set_state_nolock()) ffff99cefb0ab800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788748554.088931:0:14319:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:0.0:1788748554.089550:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58c964ac-5e91-4166-9f7a-7c26cfcbe23d+14:2346:x1875638358246400:12345-192.168.203.4@tcp:39:umount.0 Request processed in 1271us (3953us total) trans 8589934627 rc 0/0 00000100:00100000:0.0:1788748554.089577:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 55 00000020:00010000:3.0:1788748554.091274:0:15500:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99cef746e800: total 0 00010000:00010000:3.0:1788748554.091288:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748554.092009:0:15500:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99cef746e800, canceled 0 locks, left on hash table 7. 00010000:00010000:3.0:1788748554.092289:0:15500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cec6646a00) 00010000:00010000:3.0:1788748554.092294:0:15500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788748554.092309:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7d522 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b34 expref: 13 pid: 16300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748554.092395:0:15500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cec6646a00) 00010000:00010000:3.0:1788748554.092398:0:15500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788748554.092403:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42800/0x5b377f42a7a7d545 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b42 expref: 12 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748554.092490:0:15500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cec6646000) 00010000:00010000:3.0:1788748554.092493:0:15500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748554.092498:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3400/0x5b377f42a7a7d3e7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ad2 expref: 11 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748554.092514:0:15500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646800) 00010000:00010000:3.0:1788748554.092516:0:15500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788748554.092521:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2600/0x5b377f42a7a7d41f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ae0 expref: 10 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748554.092534:0:15500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99cec6646100) 00010000:00010000:3.0:1788748554.092536:0:15500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788748554.092560:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3800/0x5b377f42a7a7d5a0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b57 expref: 9 pid: 16300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748554.092579:0:15500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99cec6646b00) 00010000:00010000:3.0:1788748554.092582:0:15500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788748554.092585:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3200/0x5b377f42a7a7d3cb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521acb expref: 8 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748554.092759:0:15500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99ced1a56b00) 00010000:00010000:3.0:1788748554.092762:0:15500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788748554.092767:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced7b42000/0x5b377f42a7a7d4a4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b0a expref: 7 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748554.092782:0:15500:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99cef746e800, canceled 7 locks, left on hash table 0. 00010000:00010000:3.0:1788748554.092801:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748554.092803:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748554.092806:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748554.864116:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788748555.576350:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 58c964ac-5e91-4166-9f7a-7c26cfcbe23d 00000001:00080000:0.0:1788748555.576370:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:0.0:1788748555.576381:0:5866:0:(genops.c:885:class_export_put()) final put ffff99cef746e800/58c964ac-5e91-4166-9f7a-7c26cfcbe23d 00000020:00000080:1.0:1788748555.576539:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cef746e800/58c964ac-5e91-4166-9f7a-7c26cfcbe23d for lustre-MDT0000 00000020:00000080:1.0:1788748555.576604:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cefb0ab800 for lustre-MDT0000 00010000:00010000:1.0:1788748555.885362:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748556.051091:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748556.051124:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748556.051163:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748556.051262:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358246528 00000100:00100000:2.0:1788748556.051272:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358246528 00000100:00100000:2.0:1788748556.051330:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358246784 00000100:00100000:2.0:1788748556.051333:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358246784 00000100:00100000:2.0:1788748556.051347:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358246656 00000100:00100000:2.0:1788748556.051350:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358246656 00000100:00100000:2.0:1788748556.051365:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:2.0:1788748556.051374:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78d8312a-c6be-424c-9507-3b6e26d87fc6+12:2348:x1875638358246528:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748556.051402:0:14305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748556.051424:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ceed6f9000/0x5b377f42a7a7d33f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521a5b expref: 12 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748556.051441:0:14305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748556.051498:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78d8312a-c6be-424c-9507-3b6e26d87fc6+11:2348:x1875638358246528:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 124us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748556.051506:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:2.0:1788748556.051527:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:2.0:1788748556.051533:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78d8312a-c6be-424c-9507-3b6e26d87fc6+10:2348:x1875638358246784:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748556.051542:0:14305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748556.051552:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cee536fc00/0x5b377f42a7a7d3a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521abd expref: 10 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748556.051561:0:14305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748556.051578:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78d8312a-c6be-424c-9507-3b6e26d87fc6+9:2348:x1875638358246784:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 46us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748556.051584:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:2.0:1788748556.051598:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:2.0:1788748556.051604:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78d8312a-c6be-424c-9507-3b6e26d87fc6+8:2348:x1875638358246656:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748556.051611:0:14305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748556.051619:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cee536ec00/0x5b377f42a7a7d346 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521a85 expref: 8 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748556.051628:0:14305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748556.051644:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78d8312a-c6be-424c-9507-3b6e26d87fc6+7:2348:x1875638358246656:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 40us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748556.051656:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:2.0:1788748556.057820:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748556.057927:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358247040 00000100:00100000:3.0:1788748556.057938:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358247040 00000100:00100000:3.0:1788748556.058041:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 56 00000100:00100000:3.0:1788748556.058051:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb271f1b-92e5-4fbb-963b-7b6519557c0b+6:2346:x1875638358247040:12345-192.168.203.4@tcp:39:umount.0 00000020:00000080:3.0:1788748556.058089:0:14320:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7d354 00000020:00010000:3.0:1788748556.058097:0:14320:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99ced3542800: total 0 00000100:00080000:3.0:1788748556.058102:0:14320:0:(import.c:65:import_set_state_nolock()) ffff99ced3545000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788748556.058133:0:14320:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:3.0:1788748556.058715:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb271f1b-92e5-4fbb-963b-7b6519557c0b+5:2346:x1875638358247040:12345-192.168.203.4@tcp:39:umount.0 Request processed in 663us (900us total) trans 8589934628 rc 0/0 00000100:00100000:3.0:1788748556.058724:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 56 00000020:00010000:2.0:1788748556.058944:0:15500:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99ced3542800: total 0 00010000:00010000:2.0:1788748556.058987:0:15500:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99ced3542800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788748556.059053:0:15500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646800) 00010000:00010000:2.0:1788748556.059057:0:15500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788748556.059065:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3600/0x5b377f42a7a7d42d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ae7 expref: 4 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748556.059087:0:15500:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99ced3542800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788748556.059098:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748556.059100:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748556.059101:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788748556.059269:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748556.074381:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748556.074537:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358247296 00000100:00100000:3.0:1788748556.074558:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358247296 00000100:00100000:3.0:1788748556.074613:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 130 00000100:00100000:3.0:1788748556.074622:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec3cab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+7:2346:x1875638358247296:12345-192.168.203.4@tcp:251:umount.0 00000020:00000080:3.0:1788748556.074668:0:14312:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7d2f9 00000020:00010000:3.0:1788748556.074676:0:14312:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99cefb0a8800: total 0 00000100:00080000:3.0:1788748556.074680:0:14312:0:(import.c:65:import_set_state_nolock()) ffff99cefb0a9800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788748556.074984:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec3cab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:78d8312a-c6be-424c-9507-3b6e26d87fc6+3:2346:x1875638358247296:12345-192.168.203.4@tcp:251:umount.0 Request processed in 362us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748556.074991:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 130 00000020:00010000:2.0:1788748556.077825:0:14306:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99cefb0a8800: total 0 00010000:00010000:3.0:1788748556.081048:0:14306:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99cefb0a8800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788748556.081109:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ceecec3c00/0x5b377f42a7a7d300 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee62265219f2 expref: 2 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748556.081135:0:14306:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99cefb0a8800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788748556.081146:0:14306:0:(genops.c:885:class_export_put()) final put ffff99cefb0a8800/78d8312a-c6be-424c-9507-3b6e26d87fc6 00010000:00010000:3.0:1788748556.081173:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748556.081176:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748556.081179:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788748556.081379:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefb0a8800/78d8312a-c6be-424c-9507-3b6e26d87fc6 for MGS 00000020:00000080:2.0:1788748556.081427:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cefb0a9800 for MGS 00000100:00100000:0.0:1788748556.527438:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788748556.527461:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377098368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788748556.527526:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748556.527586:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377098368 00000100:00100000:0.0:1788748556.527593:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377098368 00000100:00100000:0.0:1788748556.527655:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788748556.527666:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377098368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788748556.527709:0:15008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788748556.527753:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377098368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748556.527760:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788748556.527807:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377098368:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788748556.528480:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1788748556.591520:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 58c964ac-5e91-4166-9f7a-7c26cfcbe23d 00000020:00000080:1.0:1788748556.591529:0:7648:0:(genops.c:885:class_export_put()) final put ffff99cee517d800/58c964ac-5e91-4166-9f7a-7c26cfcbe23d 00000020:00000080:0.0:1788748556.591607:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cee517d800/58c964ac-5e91-4166-9f7a-7c26cfcbe23d for lustre-OST0001 00000020:00000080:0.0:1788748556.591666:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cee5178800 for lustre-OST0001 00010000:00010000:1.0:1788748556.909125:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748557.054446:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788748557.054469:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377098496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748557.054532:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748557.054775:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9f57890-027b-4d36-a4ce-36a41fae69fb:3306:1875638377098624:0@lo:400:kworker.0 00000100:00100000:3.0:1788748557.054807:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748557.054830:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377099136:0@lo:400:kworker.0 00000100:00100000:3.0:1788748557.054854:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748557.054873:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788748557.054878:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377098752:0@lo:400:kworker.0 00000100:00100000:3.0:1788748557.054931:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748557.054959:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875638377098880:0@lo:400:kworker.0 00000100:00100000:3.0:1788748557.054977:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748557.054993:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788748557.054998:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377099008:0@lo:400:kworker.0 00000100:00100000:3.0:1788748557.055060:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748557.055087:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377099136 00000100:00100000:3.0:1788748557.055094:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377099136 00000100:00100000:3.0:1788748557.055139:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377098880 00000100:00100000:3.0:1788748557.055143:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377098880 00000100:00100000:3.0:1788748557.055158:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377099008 00000100:00100000:3.0:1788748557.055160:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377099008 00000100:00100000:3.0:1788748557.055174:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788748557.055182:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377099136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748557.055231:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875638377099136:12345-0@lo:400:kworker.0 Request processed in 50us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748557.055238:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788748557.055256:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788748557.055261:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875638377098880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748557.055292:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875638377098880:12345-0@lo:400:kworker.0 Request processed in 31us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748557.055297:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788748557.055308:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788748557.055314:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377099008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748557.055338:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377099008:12345-0@lo:400:kworker.0 Request processed in 24us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748557.055343:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788748557.055370:0:15495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377098752 00000100:00100000:3.0:1788748557.055374:0:15495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377098752 00000100:00100000:3.0:1788748557.055395:0:15495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788748557.055402:0:15495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377098752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748557.055434:0:15495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377098752:12345-0@lo:400:kworker.0 Request processed in 34us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748557.055440:0:15495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788748557.055457:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748557.055490:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377098752:0@lo:400:kworker.0 00000100:00100000:3.0:1788748557.055500:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875638377099136:0@lo:400:kworker.0 00000100:00100000:3.0:1788748557.055528:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377099008:0@lo:400:kworker.0 00000100:00100000:3.0:1788748557.055536:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875638377098880:0@lo:400:kworker.0 00000100:00100000:0.0:1788748557.061076:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377098496 00000100:00100000:0.0:1788748557.061091:0:15008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377098496 00000100:00100000:0.0:1788748557.061146:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788748557.061158:0:15008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377098496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788748557.061194:0:15008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788748557.061269:0:15008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377098496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (6737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748557.061287:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788748557.061314:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377098624 00000100:00100000:0.0:1788748557.061318:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377098624 00000100:00100000:0.0:1788748557.061343:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788748557.061350:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec3ca8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:3306:x1875638377098624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748557.061386:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec3ca8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:3306:x1875638377098624:12345-0@lo:400:kworker.0 Request processed in 37us (6578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748557.061393:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:0.0:1788748557.061598:0:14314:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788748557.061639:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377098496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748557.061674:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9f57890-027b-4d36-a4ce-36a41fae69fb:3306:1875638377098624:0@lo:400:kworker.0 00000020:01000004:3.0:1788748557.711888:0:17462:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1788748557.728462:0:17462:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788748557.728581:0:17462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7d028 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d02f expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748557.728595:0:17462:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7d028 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d02f expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748557.728603:0:17462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7d028 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7d02f expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748557.728610:0:17462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7d028 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7d02f expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748557.728671:0:17462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788748557.728690:0:17462:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788748557.728715:0:17462:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788748557.728718:0:17462:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788748557.728724:0:17462:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788748557.728746:0:17462:0:(import.c:65:import_set_state_nolock()) ffff99ced141a800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788748557.728948:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875638377099264:0@lo:39:umount.0 00000100:00100000:1.0:1788748557.729046:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748557.729533:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377099264 00000100:00100000:3.0:1788748557.729540:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377099264 00000100:00100000:3.0:1788748557.729591:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788748557.729600:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875638377099264:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788748557.729631:0:14318:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7d059 00000100:00080000:3.0:1788748557.729639:0:14318:0:(import.c:65:import_set_state_nolock()) ffff99cefd3ca800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788748557.729824:0:15500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748557.729832:0:15500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7d028 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7d02f expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748557.729841:0:15500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147d000 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:2.0:1788748557.729845:0:15500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7d028 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7d02f expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748557.729853:0:15500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7d028 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b377f42a7a7d02f expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748557.729860:0:15500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7d028 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b377f42a7a7d02f expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748557.729875:0:15500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788748557.729878:0:15500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788748557.729880:0:15500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788748557.729907:0:15500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7d028 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7d02f expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748557.729923:0:15500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748557.729952:0:15500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7d028 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7d02f expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748557.729959:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cec147d000/0x5b377f42a7a7d028 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7d02f expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748557.729973:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748557.729975:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748557.729976:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748557.729983:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788748557.729993:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9f57890-027b-4d36-a4ce-36a41fae69fb:3306:1875638377099392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788748557.730052:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748557.730099:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377099392 00000100:00100000:2.0:1788748557.730103:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377099392 00000100:00100000:2.0:1788748557.730152:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788748557.730160:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7307800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9f57890-027b-4d36-a4ce-36a41fae69fb+19:3306:x1875638377099392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788748557.730172:0:14305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748557.730186:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cec147cc00/0x5b377f42a7a7d02f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b377f42a7a7d028 expref: 19 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748557.730199:0:14305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748557.730241:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7307800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9f57890-027b-4d36-a4ce-36a41fae69fb+18:3306:x1875638377099392:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748557.730248:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788748557.730289:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9f57890-027b-4d36-a4ce-36a41fae69fb:3306:1875638377099392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788748557.730459:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3305:x1875638377099264:12345-0@lo:39:umount.0 Request processed in 859us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748557.730467:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000020:00000080:3.0:1788748557.730474:0:14318:0:(genops.c:885:class_export_put()) final put ffff99cefd3cf000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1788748557.730635:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788748557.730929:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefd3cf000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788748557.730981:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cefd3ca800 for lustre-MDT0000 00000100:00080000:1.0:1788748557.731010:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99ced141a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788748557.731047:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875638377099264:0@lo:39:umount.0 00000100:00080000:2.0:1788748557.731121:0:17462:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788748557.731125:0:17462:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788748557.731130:0:17462:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788748557.732352:0:17462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceecec2000/0x5b377f42a7a7cf8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7cf95 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748557.732367:0:17462:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceecec2000/0x5b377f42a7a7cf8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7cf95 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748557.732374:0:17462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceecec2000/0x5b377f42a7a7cf8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7cf95 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748557.732440:0:17462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff99ceecec2000/0x5b377f42a7a7cf8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7cf95 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748557.732462:0:17462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748557.732468:0:17462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536f800/0x5b377f42a7a7d220 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d227 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748557.732475:0:17462:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536f800/0x5b377f42a7a7d220 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d227 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748557.732480:0:17462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536f800/0x5b377f42a7a7d220 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7d227 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748557.732609:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748557.732617:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99ceecec2000/0x5b377f42a7a7cf8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7cf95 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748557.732635:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2000 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:1.0:1788748557.732639:0:14307:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99ceecec2000/0x5b377f42a7a7cf8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7cf95 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748557.732647:0:14307:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99ceecec2000/0x5b377f42a7a7cf8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b377f42a7a7cf95 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748557.732655:0:14307:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99ceecec2000/0x5b377f42a7a7cf8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b377f42a7a7cf95 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748557.732661:0:14307:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788748557.732663:0:14307:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788748557.732694:0:14307:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99ceecec2000/0x5b377f42a7a7cf8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7cf95 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748557.732701:0:14307:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748557.732723:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99ceecec2000/0x5b377f42a7a7cf8e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7cf95 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748557.732730:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99ceecec2000/0x5b377f42a7a7cf8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7cf95 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748557.732743:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748557.732745:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748557.732747:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748557.732762:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9f57890-027b-4d36-a4ce-36a41fae69fb:3308:1875638377099520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748557.732816:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748557.732875:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377099520 00000100:00100000:1.0:1788748557.732882:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377099520 00000100:00100000:1.0:1788748557.732943:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788748557.732952:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9f57890-027b-4d36-a4ce-36a41fae69fb+18:3308:x1875638377099520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788748557.732963:0:14304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748557.732976:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cec147d200/0x5b377f42a7a7cf95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b377f42a7a7cf8e expref: 18 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748557.732989:0:14304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748557.733044:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9f57890-027b-4d36-a4ce-36a41fae69fb+17:3308:x1875638377099520:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748557.733051:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788748557.733088:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9f57890-027b-4d36-a4ce-36a41fae69fb:3308:1875638377099520:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788748557.733331:0:17462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff99cee536f800/0x5b377f42a7a7d220 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7d227 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748557.733351:0:17462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748557.733358:0:17462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536f000/0x5b377f42a7a7d39a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d3a1 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748557.733364:0:17462:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536f000/0x5b377f42a7a7d39a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d3a1 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748557.733370:0:17462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536f000/0x5b377f42a7a7d39a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7d3a1 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748557.733377:0:17462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff99cee536f000/0x5b377f42a7a7d39a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7d3a1 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748557.733569:0:17462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788748557.733577:0:17462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceecec2e00/0x5b377f42a7a7cf80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7cf87 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748557.733585:0:17462:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceecec2e00/0x5b377f42a7a7cf80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7cf87 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748557.733591:0:17462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceecec2e00/0x5b377f42a7a7cf80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7cf87 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748557.733597:0:17462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff99ceecec2e00/0x5b377f42a7a7cf80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7cf87 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748557.733641:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788748557.733647:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cee536f800/0x5b377f42a7a7d220 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7d227 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748557.733654:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536f800 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:1.0:1788748557.733658:0:14306:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cee536f800/0x5b377f42a7a7d220 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7d227 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748557.733666:0:14306:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cee536f800/0x5b377f42a7a7d220 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b377f42a7a7d227 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748557.733673:0:14306:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cee536f800/0x5b377f42a7a7d220 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b377f42a7a7d227 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748557.733679:0:14306:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788748557.733681:0:14306:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788748557.733684:0:14306:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788748557.733702:0:14306:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cee536f800/0x5b377f42a7a7d220 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7d227 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748557.733714:0:14306:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748557.733730:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cee536f800/0x5b377f42a7a7d220 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7d227 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748557.733736:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cee536f800/0x5b377f42a7a7d220 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7d227 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748557.733750:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788748557.733753:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cee536f000/0x5b377f42a7a7d39a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7d3a1 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748557.733758:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536f000 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:1.0:1788748557.733761:0:14306:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cee536f000/0x5b377f42a7a7d39a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7d3a1 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748557.733768:0:14306:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cee536f000/0x5b377f42a7a7d39a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b377f42a7a7d3a1 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748557.733774:0:14306:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cee536f000/0x5b377f42a7a7d39a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b377f42a7a7d3a1 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748557.733779:0:14306:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788748557.733782:0:14306:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788748557.733783:0:14306:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788748557.733796:0:14306:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cee536f000/0x5b377f42a7a7d39a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7d3a1 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748557.733801:0:14306:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748557.733816:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cee536f000/0x5b377f42a7a7d39a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7d3a1 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748557.733833:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cee536f000/0x5b377f42a7a7d39a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7d3a1 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748557.733842:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748557.733845:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99ceecec2e00/0x5b377f42a7a7cf80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7cf87 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748557.733850:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2e00 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:1.0:1788748557.733853:0:14306:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99ceecec2e00/0x5b377f42a7a7cf80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7cf87 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748557.733860:0:14306:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99ceecec2e00/0x5b377f42a7a7cf80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b377f42a7a7cf87 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748557.733866:0:14306:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99ceecec2e00/0x5b377f42a7a7cf80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b377f42a7a7cf87 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748557.733871:0:14306:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788748557.733873:0:14306:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:1.0:1788748557.733885:0:14306:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99ceecec2e00/0x5b377f42a7a7cf80 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7cf87 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748557.733891:0:14306:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748557.733897:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99ceecec2e00/0x5b377f42a7a7cf80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7cf87 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748557.733903:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748557.733905:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748557.733906:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748557.733935:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9f57890-027b-4d36-a4ce-36a41fae69fb:3306:1875638377099776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748557.733976:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748557.734036:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788748557.734043:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9f57890-027b-4d36-a4ce-36a41fae69fb:3306:1875638377099904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748557.734066:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748557.734097:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377099776 00000100:00100000:1.0:1788748557.734102:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377099776 00000100:00100000:1.0:1788748557.734146:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377099904 00000100:00100000:1.0:1788748557.734149:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377099904 00000100:00100000:1.0:1788748557.734167:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788748557.734175:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef2b70450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9f57890-027b-4d36-a4ce-36a41fae69fb+18:3306:x1875638377099776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788748557.734185:0:14303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748557.734196:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced13e5a00/0x5b377f42a7a7d3a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b377f42a7a7d39a expref: 18 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748557.734207:0:14303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748557.734236:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef2b70450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9f57890-027b-4d36-a4ce-36a41fae69fb+17:3306:x1875638377099776:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748557.734243:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788748557.734279:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788748557.734285:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9f57890-027b-4d36-a4ce-36a41fae69fb+16:3306:x1875638377099904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788748557.734292:0:14303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748557.734299:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cec147ce00/0x5b377f42a7a7cf87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b377f42a7a7cf80 expref: 16 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748557.734311:0:14303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748557.734331:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9f57890-027b-4d36-a4ce-36a41fae69fb+15:3306:x1875638377099904:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748557.734346:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788748557.734365:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9f57890-027b-4d36-a4ce-36a41fae69fb:3309:1875638377099648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748557.734399:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748557.734427:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377099648 00000100:00100000:1.0:1788748557.734430:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377099648 00000100:00100000:1.0:1788748557.734450:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788748557.734456:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9f57890-027b-4d36-a4ce-36a41fae69fb+15:3309:x1875638377099648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788748557.734463:0:14305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748557.734472:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ceed6f8800/0x5b377f42a7a7d227 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b377f42a7a7d220 expref: 15 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748557.734481:0:14305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788748557.734595:0:17462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788748557.734601:0:17462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99ceecec2e00/0x5b377f42a7a7cf80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7cf87 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748557.734612:0:17462:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:2.0:1788748557.734616:0:17462:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788748557.734618:0:17462:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788748557.734645:0:17462:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788748557.734649:0:17462:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788748557.734653:0:17462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788748557.734660:0:17462:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:2.0:1788748557.734665:0:17462:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff99cee516b800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788748557.734670:0:17462:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff99cee516a800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788748557.734677:0:17462:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff99ced3542800 eb271f1b-92e5-4fbb-963b-7b6519557c0b 192.168.203.4@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:2.0:1788748557.734682:0:17462:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff99ceecf90000) has exports, disconnecting them 00000020:00080000:2.0:1788748557.734686:0:17462:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99cee516b800), last request at 1788748557 00000020:00000080:2.0:1788748557.734693:0:17462:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7d212 00000100:00080000:2.0:1788748557.734709:0:17462:0:(import.c:65:import_set_state_nolock()) ffff99cee516a000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788748557.734754:0:17462:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cee516b800): rc 0 00000020:00000080:2.0:1788748557.734757:0:17462:0:(genops.c:885:class_export_put()) final put ffff99cee516b800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788748557.734768:0:17462:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99cee516a800), last request at 1788748557 00000020:00000080:2.0:1788748557.734772:0:17462:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7d0de 00000100:00080000:2.0:1788748557.734777:0:17462:0:(import.c:65:import_set_state_nolock()) ffff99cee516d800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788748557.734783:0:17462:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cee516a800): rc 0 00000020:00000080:2.0:1788748557.734785:0:17462:0:(genops.c:885:class_export_put()) final put ffff99cee516a800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1788748557.734791:0:17462:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb6f5445e7ae0 00000100:00080000:2.0:1788748557.734807:0:17462:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788748557.734816:0:17462:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1788748557.734828:0:17462:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788748557.734895:0:17462:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788748557.734921:0:17462:0:(import.c:65:import_set_state_nolock()) ffff99cec6630800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788748557.734933:0:17462:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788748557.734935:0:17462:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 3 00000004:00080000:2.0:1788748557.734943:0:17462:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788748557.735000:0:17462:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788748557.735008:0:17462:0:(import.c:65:import_set_state_nolock()) ffff99cec44ca000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788748557.735047:0:17462:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff99ceecf90000) has no exports 00000100:00100000:1.0:1788748557.735260:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9f57890-027b-4d36-a4ce-36a41fae69fb+14:3309:x1875638377099648:12345-0@lo:103:ldlm_bl.0 Request processed in 803us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748557.735268:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1788748557.735360:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748557.735436:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9f57890-027b-4d36-a4ce-36a41fae69fb:3306:1875638377099904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748557.735449:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9f57890-027b-4d36-a4ce-36a41fae69fb:3306:1875638377099776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748557.735480:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377100032:0@lo:9:umount.0 00000100:00100000:1.0:1788748557.735589:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748557.735613:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7307100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377100160:0@lo:9:umount.0 00000100:00100000:1.0:1788748557.735633:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748557.735663:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377100032 00000100:00100000:1.0:1788748557.735668:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377100032 00000100:00100000:1.0:1788748557.735698:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377100160 00000100:00100000:1.0:1788748557.735708:0:15007:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377100160 00000100:00100000:1.0:1788748557.735732:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788748557.735739:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875638377100032:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788748557.735759:0:15007:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7d0fa 00000100:00080000:1.0:1788748557.735768:0:15007:0:(import.c:65:import_set_state_nolock()) ffff99cee516f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788748557.735796:0:15007:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1788748557.736318:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3305:x1875638377100032:12345-0@lo:9:umount.0 Request processed in 578us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748557.736326:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788748557.736341:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788748557.736348:0:15007:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875638377100160:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788748557.736363:0:15007:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7d22e 00000100:00080000:1.0:1788748557.736370:0:15007:0:(import.c:65:import_set_state_nolock()) ffff99cefd768000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788748557.736395:0:15007:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:1.0:1788748557.736722:0:15007:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3305:x1875638377100160:12345-0@lo:9:umount.0 Request processed in 374us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748557.736728:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1788748557.736756:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748557.736764:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748557.736844:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9f57890-027b-4d36-a4ce-36a41fae69fb:3309:1875638377099648:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788748557.737365:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788748557.737389:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99cee516b800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788748557.737437:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99cee516a800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788748557.737466:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cee516a000 for lustre-MDT0000 00000020:00000080:3.0:1788748557.737470:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cee516d800 for lustre-MDT0000 00000100:00080000:0.0:1788748557.737765:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99cec6630800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788748557.737784:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788748557.737787:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788748557.737791:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377100032:0@lo:9:umount.0 00000100:00080000:0.0:1788748557.737804:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99cec44ca000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788748557.737818:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788748557.737820:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788748557.737822:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7307100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377100160:0@lo:9:umount.0 00000020:00080000:3.0:1788748557.744171:0:17462:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff99ceecf90000) has no exports 00000020:00000080:3.0:1788748557.795600:0:17462:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7cfdb 00000020:00000080:3.0:1788748557.795615:0:17462:0:(genops.c:885:class_export_put()) final put ffff99cef2b06800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788748557.795679:0:17462:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788748557.795771:0:17462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788748557.795782:0:17462:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788748557.795786:0:17462:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff99ceecf919c0) has no exports 00000020:00000080:2.0:1788748557.796094:0:17462:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7cfd4 00000020:00000080:2.0:1788748557.796099:0:17462:0:(genops.c:885:class_export_put()) final put ffff99cec912d800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788748557.796247:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cef2b06800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788748557.796331:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cec912d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788748557.796566:0:17462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788748557.796574:0:17462:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788748557.796578:0:17462:0:(genops.c:885:class_export_put()) final put ffff99cec31aa800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788748557.796580:0:17462:0:(genops.c:844:class_export_destroy()) destroying export ffff99cec31aa800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788748557.796587:0:17462:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:1.0:1788748557.935885:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748558.957484:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748559.989096:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788748560.665692:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of eb271f1b-92e5-4fbb-963b-7b6519557c0b 00000001:00080000:0.0:1788748560.665709:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:0.0:1788748560.665714:0:5866:0:(genops.c:885:class_export_put()) final put ffff99ced3542800/eb271f1b-92e5-4fbb-963b-7b6519557c0b 00000020:00000080:0.0:1788748560.665737:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99ced3542800/eb271f1b-92e5-4fbb-963b-7b6519557c0b for lustre-MDT0000 00000020:00000080:0.0:1788748560.665812:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ced3545000 for lustre-MDT0000 00010000:00010000:1.0:1788748561.005162:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788748561.696822:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788748561.696830:0:7648:0:(genops.c:885:class_export_put()) final put ffff99cefd76b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788748561.696995:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefd76b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788748561.697092:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cefd768000 for lustre-OST0001 00010000:00010000:1.0:1788748562.029286:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748562.157687:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788748562.157709:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875638377100544:0@lo:400:kworker.0 00000100:00100000:0.0:1788748562.157777:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748562.158055:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9f57890-027b-4d36-a4ce-36a41fae69fb:3308:1875638377100288:0@lo:400:kworker.0 00000100:00100000:2.0:1788748562.158093:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748562.158143:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748562.158149:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377100416:0@lo:400:kworker.0 00000100:00100000:2.0:1788748562.158182:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748562.158899:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377100288 00000100:00100000:3.0:1788748562.158916:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377100288 00000100:00100000:3.0:1788748562.158965:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788748562.158974:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cec3caa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+14:3308:x1875638377100288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748562.159060:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cec3caa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9f57890-027b-4d36-a4ce-36a41fae69fb+14:3308:x1875638377100288:12345-0@lo:400:kworker.0 Request processed in 87us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748562.159068:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788748562.159365:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377100544 00000100:00100000:3.0:1788748562.159371:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377100544 00000100:00100000:3.0:1788748562.159404:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377100416 00000100:00100000:3.0:1788748562.159408:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377100416 00000100:00100000:3.0:1788748562.159426:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788748562.159431:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875638377100544:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788748562.159438:0:14320:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788748562.159469:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875638377100544:12345-0@lo:400:kworker.0 Request processed in 37us (1693us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788748562.159475:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788748562.159487:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788748562.159490:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1875638377100416:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788748562.159494:0:14320:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788748562.159518:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1875638377100416:12345-0@lo:400:kworker.0 Request processed in 26us (1335us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788748562.159523:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1788748562.163036:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788748562.163110:0:3307:0:(import.c:65:import_set_state_nolock()) ffff99cf01940000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788748562.163114:0:3307:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788748562.164374:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788748562.164381:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99ceecebd000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788748562.164394:0:3308:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788748562.164401:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99ceecebd000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788748562.164405:0:3308:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 412 00000100:00080000:2.0:1788748562.164417:0:3308:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99ceecebd000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1788748562.164451:0:3308:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cef7305f80 x1875638377100672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788748562.164479:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377100416:0@lo:400:kworker.0 00000100:00100000:2.0:1788748562.164494:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9f57890-027b-4d36-a4ce-36a41fae69fb:3308:1875638377100288:0@lo:400:kworker.0 00000100:00100000:2.0:1788748562.164541:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875638377100672:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788748562.164771:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748562.164917:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377100672 00000100:00100000:2.0:1788748562.164924:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377100672 00000100:00100000:2.0:1788748562.165328:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788748562.165336:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875638377100672:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1788748562.165354:0:14318:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1788748562.183975:0:3307:0:(import.c:65:import_set_state_nolock()) ffff99cf01940000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788748562.183984:0:3307:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 428 00000100:00080000:0.0:1788748562.183999:0:3307:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cf01940000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1788748562.184068:0:3307:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cef76aa300 x1875638377100800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788748562.185372:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875638377100544:0@lo:400:kworker.0 00000100:00100000:3.0:1788748562.186471:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875638377100800:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788748562.186542:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748562.186594:0:16300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377100800 00000100:00100000:3.0:1788748562.186603:0:16300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377100800 00000100:00100000:3.0:1788748562.186642:0:16300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788748562.186649:0:16300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3305:x1875638377100800:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1788748562.186665:0:16300:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788748562.186709:0:16300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3305:x1875638377100800:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 58us (165us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788748562.186724:0:16300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1788748562.186765:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99cf01940000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788748562.186770:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788748562.186773:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875638377100800:0@lo:38:ptlrpcd_00_01.0 00000001:00100000:0.0:1788748562.200972:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788748562.200980:0:6723:0:(genops.c:885:class_export_put()) final put ffff99cee516b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788748562.201002:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99cee516b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788748562.201057:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cee516f800 for lustre-OST0000 00000100:00100000:2.0:1788748562.203342:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875638377100672:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 37995us (38560us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788748562.203367:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1788748562.203530:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99ceecebd000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788748562.203536:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788748562.203540:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875638377100672:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:3.0:1788748563.053384:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788748563.887224:0:17462:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ceed633240 - data ffff99ceef5db6c0/ffff99cdc5e65400 00000020:01000000:2.0:1788748563.887365:0:17462:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99cefd73e660 - data ffff99ced2f12948/ffff99ceed9bfc00 00000001:00000004:2.0:1788748563.898804:0:17462:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:0.0:1788748563.964966:0:17462:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788748563.964974:0:17462:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1788748563.964991:0:17462:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788748563.964995:0:17462:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788748563.965738:0:14340:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788748563.965744:0:14340:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:2.0:1788748563.965754:0:14340:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1788748563.971574:0:17462:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788748563.971655:0:17462:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 4 00000004:00080000:0.0:1788748563.971715:0:17462:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788748563.971722:0:17462:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788748563.977659:0:14342:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788748563.977666:0:14342:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:0.0:1788748563.977676:0:14342:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1788748564.081839:0:17462:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7cfa3 00000020:00000080:3.0:1788748564.081849:0:17462:0:(genops.c:885:class_export_put()) final put ffff99cec6632800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788748564.082565:0:17462:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7cfb8 00000020:00000080:3.0:1788748564.082572:0:17462:0:(genops.c:885:class_export_put()) final put ffff99cec6636000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788748564.082578:0:17462:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788748564.082585:0:17462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788748564.082593:0:17462:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788748564.082597:0:17462:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff99ceece70000) has no exports 00000004:01000000:3.0:1788748564.082741:0:17462:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788748564.082749:0:17462:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7d005 00000020:00000080:3.0:1788748564.082753:0:17462:0:(genops.c:885:class_export_put()) final put ffff99cef2b06000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788748564.082756:0:17462:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788748564.082760:0:17462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788748564.082764:0:17462:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788748564.082766:0:17462:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff99cefb828000) has no exports 00000020:00000080:3.0:1788748564.082771:0:17462:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7cffe 00000020:00000080:3.0:1788748564.082774:0:17462:0:(genops.c:885:class_export_put()) final put ffff99cec44ca800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788748564.083136:0:17462:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788748564.083140:0:17462:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788748564.083143:0:17462:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 5 00000004:00080000:3.0:1788748564.083148:0:17462:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788748564.083150:0:17462:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788748564.083176:0:17462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788748564.083182:0:17462:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788748564.083187:0:17462:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7cff0 00000020:00000080:3.0:1788748564.083201:0:17462:0:(genops.c:885:class_export_put()) final put ffff99cdc4e1f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788748564.083204:0:17462:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788748564.083207:0:17462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788748564.083210:0:17462:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788748564.083213:0:17462:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff99cefd4a4d40) has no exports 00000020:00000080:3.0:1788748564.083216:0:17462:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7cfe9 00000020:00000080:3.0:1788748564.083218:0:17462:0:(genops.c:885:class_export_put()) final put ffff99cec6633000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788748564.083559:0:17462:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788748564.083563:0:17462:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788748564.083565:0:17462:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1788748564.083568:0:17462:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788748564.083570:0:17462:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788748564.083590:0:17462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788748564.083595:0:17462:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788748564.083624:0:17462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788748564.083627:0:17462:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788748564.083651:0:17462:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7cfbf 00000020:00000080:3.0:1788748564.083656:0:17462:0:(genops.c:885:class_export_put()) final put ffff99cec6635000/lustre-MDD0000_UUID 00000020:01000000:3.0:1788748564.083659:0:17462:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788748564.083662:0:17462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788748564.083666:0:17462:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788748564.083667:0:17462:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff99ceecf94d40) has no exports 00000020:00000080:3.0:1788748564.083684:0:17462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788748564.083687:0:17462:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788748564.083690:0:17462:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7cfc6 00000020:00000080:3.0:1788748564.083693:0:17462:0:(genops.c:885:class_export_put()) final put ffff99cec6637000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788748564.083700:0:17462:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cefd703800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788748564.083703:0:17462:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cefd703800 3 00000020:01000004:3.0:1788748564.083705:0:17462:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99cefd703800 from lustre-MDT0000 00000020:00000080:3.0:1788748564.083723:0:17462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788748564.083725:0:17462:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788748564.083727:0:17462:0:(genops.c:885:class_export_put()) final put ffff99cec6634000/lustre-MDT0000_UUID 00000020:00000080:3.0:1788748564.083730:0:17462:0:(genops.c:844:class_export_destroy()) destroying export ffff99cec6634000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788748564.083745:0:17462:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788748564.083808:0:17462:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1788748564.083812:0:17462:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788748564.083815:0:17462:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788748564.083817:0:17462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788748564.083820:0:17462:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788748564.083825:0:17462:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff99ceeceb6800 e9f57890-027b-4d36-a4ce-36a41fae69fb 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788748564.083830:0:17462:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff99ceece719c0) has exports, disconnecting them 00000020:00080000:3.0:1788748564.083833:0:17462:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff99ceeceb6800), last request at 1788748480 00000020:00000080:3.0:1788748564.083845:0:17462:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7cf6b 00000020:00010000:3.0:1788748564.083849:0:17462:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99ceeceb6800: total 8 00000100:00080000:3.0:1788748564.083853:0:17462:0:(import.c:65:import_set_state_nolock()) ffff99cef68b7000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788748564.083885:0:17462:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ceeceb6800): rc 0 00000020:00080000:3.0:1788748564.083889:0:17462:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff99ceece719c0) has no exports 00000100:00100000:3.0:1788748564.083974:0:14312:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff99cefd974800:14312] 1 exiting: rc = 0 00000100:00100000:3.0:1788748564.084061:0:14313:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff99ced2a7c200:14313] 2 exiting: rc = 0 00000020:00000080:0.0:1788748564.084231:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cec6632800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788748564.084246:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cec6636000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1788748564.084250:0:36:0:(genops.c:885:class_export_put()) final put ffff99cef2bdb000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788748564.084252:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cef2bdb000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788748564.084256:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788748564.084367:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cef2b06000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788748564.084376:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cec44ca800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788748564.084381:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cec44ca000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788748564.084385:0:36:0:(genops.c:885:class_export_put()) final put ffff99cdc4e19000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788748564.084387:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cdc4e19000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788748564.084398:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788748564.084431:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cdc4e1f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788748564.084439:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cec6633000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788748564.084446:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cec6630800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788748564.084449:0:36:0:(genops.c:885:class_export_put()) final put ffff99cef2b01800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788748564.084451:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cef2b01800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788748564.084454:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788748564.084512:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cec6635000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788748564.084519:0:36:0:(genops.c:885:class_export_put()) final put ffff99cec6637800/lustre-MDD0000_UUID 00000020:00000080:0.0:1788748564.084521:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cec6637800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788748564.084524:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1788748564.084622:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99cec6637000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1788748564.084651:0:14310:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff99cec2c5f000:14310] 0 exiting: rc = 1 00000100:00100000:3.0:1788748564.084796:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.084804:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.084809:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.084814:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.084819:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.084830:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.084839:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.084846:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.084852:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.084857:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.084876:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.084886:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.084892:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.084898:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.084907:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.084912:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.084930:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:1.0:1788748564.085040:0:14307:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99ceeceb6800: total 0 00010000:00010000:1.0:1788748564.085054:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748564.085092:0:14307:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99ceeceb6800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1788748564.085122:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cee536f600/0x5b377f42a7a7d385 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b377f42a7a7d37e expref: 9 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748564.085138:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ceed6f9e00/0x5b377f42a7a7cf79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b377f42a7a7cf72 expref: 8 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748564.085148:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ceecec2200/0x5b377f42a7a7d0c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b377f42a7a7d0c2 expref: 7 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748564.085158:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ceed6f9400/0x5b377f42a7a7d1d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b377f42a7a7d1cc expref: 6 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748564.085168:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cee536e200/0x5b377f42a7a7d393 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b377f42a7a7d38c expref: 5 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748564.085182:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cee536ee00/0x5b377f42a7a7d091 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b377f42a7a7d08a expref: 4 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748564.085197:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cee536e000/0x5b377f42a7a7d1fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b377f42a7a7d1f6 expref: 3 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748564.085209:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cee536fe00/0x5b377f42a7a7d09f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b377f42a7a7d098 expref: 2 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748564.085219:0:14307:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99ceeceb6800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1788748564.085238:0:14307:0:(genops.c:885:class_export_put()) final put ffff99ceeceb6800/e9f57890-027b-4d36-a4ce-36a41fae69fb 00010000:00010000:1.0:1788748564.085248:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748564.085250:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748564.085251:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748564.085539:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085554:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085564:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085569:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085575:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085580:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085586:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085591:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085596:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085600:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085606:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085612:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085618:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085624:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085630:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085634:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085639:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085644:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085649:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085714:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085722:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085727:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085732:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085737:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085741:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085747:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085753:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085759:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085764:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085769:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085774:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085779:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085785:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.085790:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788748564.085844:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ceeceb6800/e9f57890-027b-4d36-a4ce-36a41fae69fb for MGS 00000020:00000080:0.0:1788748564.085885:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cef68b7000 for MGS 00000100:00100000:3.0:1788748564.086309:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.086315:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.086320:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.086325:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.086330:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.086336:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.086400:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.086405:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.086410:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.086415:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.086420:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.086426:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.086432:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1788748564.087632:0:17462:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788748564.087638:0:17462:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1788748564.091733:0:17462:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ceed633d80 - data ffff99ced2d965e8/ffff99cdc5e65c00 00000020:01000000:0.0:1788748564.091877:0:17462:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99cec3f973c0 - data ffff99ceef76e870/ffff99cefd83b800 00000020:00000080:0.0:1788748564.092453:0:17462:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7cf4f 00000020:00000080:0.0:1788748564.092461:0:17462:0:(genops.c:885:class_export_put()) final put ffff99cefd700800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788748564.092479:0:17462:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cefd703800 from MGS, refs=2 00000020:01000004:0.0:1788748564.092483:0:17462:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cefd703800 2 00000020:01000004:0.0:1788748564.092486:0:17462:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99cefd703800 from MGS 00000020:00000080:0.0:1788748564.092508:0:17462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788748564.092515:0:17462:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788748564.092518:0:17462:0:(genops.c:885:class_export_put()) final put ffff99cefd702000/MGS 00000020:00000080:0.0:1788748564.092520:0:17462:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefd702000/MGS for MGS 00000020:01000000:0.0:1788748564.092527:0:17462:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788748564.092679:0:17462:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788748564.092683:0:17462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788748564.092688:0:17462:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788748564.092694:0:17462:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff99ced141d800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788748564.092701:0:17462:0:(genops.c:1552:class_disconnect_exports()) OBD device 10 (ffff99ceecf93380) has exports, disconnecting them 00000020:00080000:0.0:1788748564.092706:0:17462:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff99ced141d800), last request at 1788748480 00000020:00000080:0.0:1788748564.092710:0:17462:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7d03d 00000020:00080000:0.0:1788748564.092720:0:17462:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ced141d800): rc 0 00000020:00000080:0.0:1788748564.092725:0:17462:0:(genops.c:885:class_export_put()) final put ffff99ced141d800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788748564.093092:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefd700800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788748564.093115:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99ced141d800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788748564.094085:0:17462:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788748564.094092:0:17462:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788748564.094097:0:17462:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788748564.094103:0:17462:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788748564.094268:0:17462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788748564.094276:0:17462:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788748564.094281:0:17462:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cefd703800 1 00000020:00000080:2.0:1788748564.094287:0:17462:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7cf41 00000020:00000080:2.0:1788748564.094294:0:17462:0:(genops.c:885:class_export_put()) final put ffff99cefd702800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788748564.094299:0:17462:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788748564.094303:0:17462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788748564.094306:0:17462:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788748564.094309:0:17462:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff99ceece74d40) has no exports 00000020:00000080:3.0:1788748564.094382:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ced141a800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788748564.094388:0:37:0:(genops.c:885:class_export_put()) final put ffff99cec912a000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788748564.094391:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99cec912a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788748564.094400:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788748564.094457:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefd702800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788748564.116515:0:17462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788748564.116530:0:17462:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788748564.116535:0:17462:0:(genops.c:885:class_export_put()) final put ffff99cefd706000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788748564.116540:0:17462:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefd706000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788748564.116546:0:17462:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788748564.116686:0:17462:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99cefd704800 00000020:01000000:3.0:1788748564.116705:0:17462:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788748564.116710:0:17462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788748564.116715:0:17462:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788748564.116718:0:17462:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff99cefd4a0000) has no exports 00000100:00100000:3.0:1788748564.116785:0:16300:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff99ceed6d9800:16300] 4 exiting: rc = 0 00000100:00100000:1.0:1788748564.117762:0:14320:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff99ceed717400:14320] 2 exiting: rc = 0 00000100:00100000:3.0:1788748564.118140:0:14318:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff99cedea64800:14318] 0 exiting: rc = 1 00000100:00100000:0.0:1788748564.118378:0:14319:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff99cedea65a00:14319] 1 exiting: rc = 0 00000100:00100000:0.0:1788748564.118431:0:15949:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff99ceed6d4a00:15949] 3 exiting: rc = 0 00000100:00100000:3.0:1788748564.118560:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118568:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118574:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118580:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118586:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118592:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118599:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118605:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118610:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118618:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118624:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118630:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118636:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118641:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118647:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118653:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118658:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118664:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118669:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118675:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118680:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118686:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118692:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118698:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118704:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118709:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118715:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118721:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118729:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118734:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118739:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118745:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118751:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118757:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118762:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118775:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118782:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118788:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118793:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118799:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118805:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118810:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118816:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118821:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118827:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118833:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118838:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118843:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118849:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118855:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118860:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118876:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118882:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118887:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118893:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118898:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118903:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118908:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118917:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118924:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118930:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118939:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118945:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.118950:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.121437:0:14322:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff99ceed716000:14322] 1 exiting: rc = 0 00000100:00100000:0.0:1788748564.124235:0:14321:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff99ceed717000:14321] 0 exiting: rc = 1 00000100:00100000:3.0:1788748564.124538:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124546:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124552:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124558:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124563:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124568:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124586:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124591:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124596:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124602:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124607:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124611:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124616:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124622:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124627:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124632:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124638:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124644:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124649:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124655:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124660:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124666:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124672:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124677:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124681:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124686:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124691:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124695:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124700:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124706:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124710:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124715:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124719:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124723:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124728:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124732:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124737:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124742:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124747:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124752:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124757:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124770:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124774:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124780:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124785:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124791:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124796:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124801:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124806:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124812:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124818:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124824:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124829:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124835:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124841:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124846:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124851:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124857:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124862:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124878:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124883:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124888:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124893:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.124898:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125292:0:14324:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff99cee5a56600:14324] 1 exiting: rc = 0 00000100:00100000:3.0:1788748564.125599:0:14323:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff99ceed717200:14323] 0 exiting: rc = 1 00000100:00100000:3.0:1788748564.125645:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125653:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125672:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125736:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125742:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125747:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125752:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125758:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125773:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125778:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125790:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125796:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125801:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125806:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125810:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125816:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125821:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125827:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125832:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125838:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125853:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125859:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125864:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125879:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125887:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125893:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125898:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125904:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125909:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125915:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125921:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125928:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125949:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125957:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125964:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.125969:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.126123:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.126132:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.126137:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.126143:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.126149:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.126154:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.126159:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.126165:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.126183:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.126193:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.126198:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.126204:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.126209:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.126214:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.126219:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.126225:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.126230:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.126236:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.126241:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.126246:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.126262:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.126268:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.126273:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.126278:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.126283:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.126288:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.126293:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.126299:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748564.138147:0:14325:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff99cee5a56000:14325] 0 exiting: rc = 1 00000100:00100000:0.0:1788748564.138239:0:14326:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff99cee5a57200:14326] 1 exiting: rc = 0 00000100:00100000:2.0:1788748564.138393:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138400:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138405:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138410:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138415:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138420:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138424:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138429:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138434:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138438:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138443:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138447:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138451:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138456:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138461:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138465:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138469:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138473:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138487:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138491:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138496:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138501:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138505:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138509:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138513:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138518:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138522:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138526:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138531:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138535:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138540:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138544:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138548:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138556:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138561:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138565:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138569:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138574:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138578:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138582:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138586:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138591:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138595:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138600:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138605:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138609:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138614:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138619:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138623:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138628:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138634:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138639:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138644:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138709:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138716:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138721:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138728:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138733:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138737:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138742:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138746:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138750:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138755:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.138759:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748564.139207:0:14328:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff99cee5a56400:14328] 1 exiting: rc = 0 00000100:00100000:0.0:1788748564.139279:0:14327:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff99cee5a56200:14327] 0 exiting: rc = 1 00000100:00100000:2.0:1788748564.147564:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147573:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147578:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147582:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147587:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147591:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147596:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147601:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147607:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147612:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147616:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147621:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147626:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147632:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147637:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147642:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147648:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147653:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147657:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147662:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147666:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147672:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147676:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147681:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147695:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147700:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147704:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147709:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147713:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147718:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147722:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147727:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147736:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147743:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147835:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147842:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147846:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147852:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147857:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147861:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147874:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147879:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147883:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147888:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147892:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147896:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147901:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147906:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147911:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147915:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147919:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147923:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147928:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147932:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147937:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147941:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147945:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147950:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147958:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147994:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.147999:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.148006:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.148029:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.148036:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.151740:0:14330:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff99cee5a57400:14330] 1 exiting: rc = 0 00000100:00100000:0.0:1788748564.155183:0:14329:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff99cee5a57e00:14329] 0 exiting: rc = 1 00000100:00100000:2.0:1788748564.155533:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155541:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155546:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155552:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155557:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155563:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155568:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155574:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155578:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155584:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155589:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155595:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155600:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155605:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155610:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155614:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155619:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155623:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155628:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155633:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155638:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155644:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155649:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155654:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155658:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155664:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155669:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155674:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155679:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155696:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155701:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155705:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155711:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155715:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155720:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155725:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155730:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155735:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155740:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155745:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155749:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155754:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155759:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155763:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155768:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155774:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155779:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155785:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155789:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155795:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155800:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155805:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155811:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155816:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155820:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155826:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155831:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155836:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155841:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155846:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155851:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155856:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155862:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.155879:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748564.157372:0:14331:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff99cee5a57600:14331] 0 exiting: rc = 1 00000100:00100000:1.0:1788748564.157451:0:14333:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff99ceecd33000:14333] 2 exiting: rc = 0 00000100:00100000:3.0:1788748564.157559:0:14332:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff99ceed741e00:14332] 1 exiting: rc = 0 00000100:00100000:2.0:1788748564.162302:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162326:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162334:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162356:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162363:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162370:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162375:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162407:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162415:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162428:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162434:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162440:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162445:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162459:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162466:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162473:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162496:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162502:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162508:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162514:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162520:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162527:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162534:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162540:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162546:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162551:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162557:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162563:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162572:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162578:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162584:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162616:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162630:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162636:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162642:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162670:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162676:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162682:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162705:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162712:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162729:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162735:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162740:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162746:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162758:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162765:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162771:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162777:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162783:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162789:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162802:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162808:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162815:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162820:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162826:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162848:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162856:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162862:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162881:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162887:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162893:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162898:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162904:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748564.162910:0:17462:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788748564.168135:0:17462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788748564.168149:0:17462:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788748564.168155:0:17462:0:(genops.c:885:class_export_put()) final put ffff99cdc4e1a800/MDS_uuid 00000020:00000080:2.0:1788748564.168159:0:17462:0:(genops.c:844:class_export_destroy()) destroying export ffff99cdc4e1a800/MDS_uuid for MDS 00000020:01000000:2.0:1788748564.168164:0:17462:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788748564.168276:0:17462:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788748564.218696:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748565.230201:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748566.256503:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788748566.958280:0:17616:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788748566.968196:0:17616:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788748566.968242:0:17616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d0c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d0c9 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748566.968257:0:17616:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d0c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d0c9 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748566.968264:0:17616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d0c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7d0c9 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748566.968271:0:17616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d0c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7d0c9 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748566.968289:0:17616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788748566.968294:0:17616:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788748566.968312:0:17616:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788748566.968316:0:17616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788748566.968327:0:17616:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788748566.968333:0:17616:0:(import.c:65:import_set_state_nolock()) ffff99ceecebd000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788748566.968338:0:17616:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788748566.968339:0:17616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788748566.968343:0:17616:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788748566.968768:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748566.968777:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d0c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7d0c9 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748566.968923:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147d600 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:1.0:1788748566.968928:0:14306:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d0c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7d0c9 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748566.968938:0:14306:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d0c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b377f42a7a7d0c9 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748566.968945:0:14306:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d0c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b377f42a7a7d0c9 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748566.968950:0:14306:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788748566.968953:0:14306:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788748566.968956:0:14306:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788748566.968996:0:14306:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d0c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7d0c9 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748566.969003:0:14306:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748566.969113:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d0c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7d0c9 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748566.969121:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cec147d600/0x5b377f42a7a7d0c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7d0c9 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748566.969134:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748566.969149:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748566.969151:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748566.969285:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9f57890-027b-4d36-a4ce-36a41fae69fb:3307:1875638377100928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788748566.969351:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748566.969873:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377100928 00000100:00100000:1.0:1788748566.969882:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377100928 00000100:00100000:1.0:1788748566.970036:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788748566.970044:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3307:x1875638377100928:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788748566.970051:0:14304:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788748566 with bad export cookie 6572862105427890027 00010000:00010000:2.0:1788748566.970875:0:17616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7d098 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d09f expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748566.970888:0:17616:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7d098 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d09f expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748566.970895:0:17616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7d098 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7d09f expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748566.970927:0:17616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7d098 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7d09f expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748566.970945:0:17616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748566.970952:0:17616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536f400/0x5b377f42a7a7d38c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d393 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748566.970959:0:17616:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536f400/0x5b377f42a7a7d38c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d393 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748566.970965:0:17616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536f400/0x5b377f42a7a7d38c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7d393 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748566.970970:0:17616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff99cee536f400/0x5b377f42a7a7d38c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7d393 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748566.970988:0:17616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788748566.970992:0:17616:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788748566.971009:0:17616:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788748566.971041:0:17616:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:2.0:1788748566.971054:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788748566.971058:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7d098 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7d09f expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748566.971065:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8c00 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:2.0:1788748566.971069:0:14307:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7d098 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7d09f expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748566.971077:0:14307:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7d098 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b377f42a7a7d09f expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748566.971091:0:14307:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7d098 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b377f42a7a7d09f expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748566.971096:0:14307:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788748566.971099:0:14307:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788748566.971101:0:14307:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1788748566.971129:0:14307:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7d098 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7d09f expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748566.971134:0:14307:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748566.971153:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7d098 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7d09f expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748566.971160:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7d098 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7d09f expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748566.971172:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748566.971175:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cee536f400/0x5b377f42a7a7d38c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7d393 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748566.971180:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536f400 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:2.0:1788748566.971183:0:14307:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cee536f400/0x5b377f42a7a7d38c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7d393 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748566.971189:0:14307:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cee536f400/0x5b377f42a7a7d38c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b377f42a7a7d393 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748566.971194:0:14307:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cee536f400/0x5b377f42a7a7d38c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b377f42a7a7d393 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748566.971208:0:14307:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788748566.971210:0:14307:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788748566.971211:0:14307:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788748566.971225:0:14307:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cee536f400/0x5b377f42a7a7d38c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7d393 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748566.971230:0:14307:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748566.971236:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cee536f400/0x5b377f42a7a7d38c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7d393 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748566.971242:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cee536f400/0x5b377f42a7a7d38c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b377f42a7a7d393 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748566.971250:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748566.971251:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748566.971253:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748566.971278:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7305c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9f57890-027b-4d36-a4ce-36a41fae69fb:3308:1875638377101056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788748566.971326:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788748566.972049:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748566.972063:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7304000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9f57890-027b-4d36-a4ce-36a41fae69fb:3309:1875638377101184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788748566.974069:0:14303:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000020:00000080:3.0:1788748566.975544:0:17616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788748566.975557:0:17616:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788748566.975563:0:17616:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff99cefd4a19c0) has no exports 00000020:00080000:3.0:1788748566.975593:0:17616:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff99cefd4a19c0) has no exports 00000100:00100000:1.0:1788748566.975771:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3307:x1875638377100928:12345-0@lo:103:ldlm_bl.0 Request processed in 5723us (6416us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788748566.975782:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788748566.976689:0:14303:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00080000:0.0:1788748566.976947:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.104@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788748566.976952:0:3307:0:(import.c:65:import_set_state_nolock()) ffff99ceecee9800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788748566.976956:0:3307:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.104@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:1.0:1788748566.976974:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377101056 00000100:00100000:1.0:1788748566.976983:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377101056 00000100:00100000:1.0:1788748566.977011:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788748566.977039:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7305500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3308:x1875638377101056:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788748566.977046:0:14304:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788748566 with bad export cookie 6572862105427890027 00000100:00100000:1.0:1788748566.977095:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7305500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3308:x1875638377101056:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (5768us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788748566.977102:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788748566.978899:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748566.979033:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377101184 00000100:00100000:1.0:1788748566.979042:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377101184 00000100:00080000:2.0:1788748566.979086:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.104@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1788748566.979087:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788748566.979096:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7306300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3309:x1875638377101184:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788748566.979103:0:14304:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788748566 with bad export cookie 6572862105427890027 00000100:00100000:1.0:1788748566.979882:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7306300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3309:x1875638377101184:12345-0@lo:103:ldlm_bl.0 Request processed in 782us (984us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788748566.979894:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000020:01000000:3.0:1788748566.981555:0:17616:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ced1a678a0 - data ffff99ceef5d9ca8/ffff99cdc6a51c00 00000020:01000000:3.0:1788748566.981697:0:17616:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99cedea14840 - data ffff99cedb088798/ffff99cdc4c47000 00000100:00080000:0.0:1788748566.983818:0:3307:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.104@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788748566.983823:0:3307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788748566.983831:0:3307:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cef730fb80 x1875638377100928/t0(0) o103->MGC192.168.203.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788748582 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748566.983842:0:3307:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cef7305c00 x1875638377101056/t0(0) o103->MGC192.168.203.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788748582 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748566.984001:0:3307:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cef7304000 x1875638377101184/t0(0) o103->MGC192.168.203.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788748582 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788748566.984011:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788748566.984028:0:3308:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff99ceecee9800 already not connected (conn 1, was 1): DISCONN 00000100:00080000:0.0:1788748566.984049:0:3307:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788748566.984050:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788748566.984054:0:3307:0:(import.c:65:import_set_state_nolock()) ffff99ceecee9800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788748566.984060:0:3307:0:(import.c:545:import_select_connection()) MGC192.168.203.104@tcp: connect to NID 0@lo last attempt 397 00000100:00080000:0.0:1788748566.984074:0:3307:0:(import.c:666:import_select_connection()) MGC192.168.203.104@tcp: import ffff99ceecee9800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1788748566.984081:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7304000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9f57890-027b-4d36-a4ce-36a41fae69fb:3309:1875638377101184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788748566.984103:0:3307:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cef76abb80 x1875638377101312/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788748566.984106:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7305c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9f57890-027b-4d36-a4ce-36a41fae69fb:3308:1875638377101056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788748566.984144:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e9f57890-027b-4d36-a4ce-36a41fae69fb:3305:1875638377101312:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:0.0:1788748566.984183:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875638377101312 offset 0 length 520: 4 00000100:00100000:0.0:1788748566.984240:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9f57890-027b-4d36-a4ce-36a41fae69fb:3307:1875638377100928:0@lo:103:ldlm_bl.0 00100000:10000000:3.0:1788748567.004175:0:17616:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788748567.025141:0:17616:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7d0ad 00000020:00000080:0.0:1788748567.025151:0:17616:0:(genops.c:885:class_export_put()) final put ffff99cefd3bb800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788748567.025169:0:17616:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cec31d3800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788748567.025173:0:17616:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cec31d3800 2 00000020:01000004:0.0:1788748567.025177:0:17616:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99cec31d3800 from lustre-OST0000 00000020:00000080:0.0:1788748567.025208:0:17616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788748567.025217:0:17616:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788748567.025220:0:17616:0:(genops.c:885:class_export_put()) final put ffff99cefd3b8800/lustre-OST0000_UUID 00000020:00000080:0.0:1788748567.025223:0:17616:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefd3b8800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788748567.025230:0:17616:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788748567.025280:0:17616:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788748567.025285:0:17616:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788748567.025289:0:17616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788748567.025294:0:17616:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788748567.025301:0:17616:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff99ceeceba000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788748567.025307:0:17616:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff99ced2340000) has exports, disconnecting them 00000020:00080000:0.0:1788748567.025312:0:17616:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff99ceeceba000), last request at 1788748495 00000020:00000080:0.0:1788748567.025315:0:17616:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7d0d7 00000020:00080000:0.0:1788748567.025444:0:17616:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ceeceba000): rc 0 00000020:00000080:0.0:1788748567.025450:0:17616:0:(genops.c:885:class_export_put()) final put ffff99ceeceba000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788748567.026135:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefd3bb800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788748567.026145:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99ceeceba000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788748567.027319:0:17616:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788748567.027325:0:17616:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788748567.027339:0:17616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788748567.027345:0:17616:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788748567.027455:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ceecebd000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788748567.027509:0:17616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788748567.027517:0:17616:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788748567.027522:0:17616:0:(genops.c:885:class_export_put()) final put ffff99cec653d000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788748567.027525:0:17616:0:(genops.c:844:class_export_destroy()) destroying export ffff99cec653d000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788748567.027534:0:17616:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1788748567.027581:0:17616:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cec31d3800 1 00000020:00000080:1.0:1788748567.027586:0:17616:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7d07c 00000020:00000080:1.0:1788748567.027592:0:17616:0:(genops.c:885:class_export_put()) final put ffff99cefd852000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788748567.027606:0:17616:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788748567.027611:0:17616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788748567.027614:0:17616:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788748567.027617:0:17616:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff99cefd4a3380) has no exports 00000020:00000080:2.0:1788748567.027629:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefd852000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788748567.042336:0:17616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788748567.042350:0:17616:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788748567.042356:0:17616:0:(genops.c:885:class_export_put()) final put ffff99cef68b3800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788748567.042361:0:17616:0:(genops.c:844:class_export_destroy()) destroying export ffff99cef68b3800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788748567.042370:0:17616:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788748567.042493:0:17616:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99cec8724800 00000020:02000400:2.0:1788748567.042546:0:17616:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:0.0:1788748567.278008:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788748567.278045:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788748567.278050:0:36:0:(import.c:65:import_set_state_nolock()) ffff99cf01940000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788748567.278058:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 479 00000100:00080000:0.0:1788748567.278063:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788748567.278078:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cf01940000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1788748567.278118:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cef76aad80 x1875638377101440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788748567.278299:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875638377101440:0@lo:38:kworker.0 00000400:00000100:2.0:1788748567.278348:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875638377101440 offset 0 length 520: 4 00010000:00010000:2.0:1788748567.278773:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748568.301327:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748569.326583:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788748569.507510:0:17767:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788748569.523108:0:17767:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788748569.523179:0:17767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536e600/0x5b377f42a7a7d1f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d1fd expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748569.523194:0:17767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536e600/0x5b377f42a7a7d1f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d1fd expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748569.523202:0:17767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536e600/0x5b377f42a7a7d1f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7d1fd expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748569.523208:0:17767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff99cee536e600/0x5b377f42a7a7d1f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7d1fd expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748569.523227:0:17767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788748569.523232:0:17767:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788748569.523252:0:17767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788748569.523262:0:17767:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cef76aad80 x1875638377101440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788748582 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748569.523296:0:17767:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00010000:00010000:1.0:1788748569.523389:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748569.523396:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cee536e600/0x5b377f42a7a7d1f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7d1fd expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748569.523404:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536e600 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:1.0:1788748569.523408:0:14306:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cee536e600/0x5b377f42a7a7d1f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7d1fd expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748569.523416:0:14306:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cee536e600/0x5b377f42a7a7d1f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b377f42a7a7d1fd expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748569.523423:0:14306:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cee536e600/0x5b377f42a7a7d1f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b377f42a7a7d1fd expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748569.523429:0:14306:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788748569.523432:0:14306:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788748569.523434:0:14306:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788748569.523452:0:14306:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99ceecee9800 00010000:00010000:1.0:1788748569.523456:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cee536e600/0x5b377f42a7a7d1f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b377f42a7a7d1fd expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748569.523462:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cee536e600/0x5b377f42a7a7d1f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b377f42a7a7d1fd expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748569.523472:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748569.523474:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748569.523476:0:14306:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788748569.523541:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99cf01940000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788748569.523547:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:3.0:1788748569.523551:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875638377101440:0@lo:38:kworker.0 00000100:00080000:2.0:1788748569.523592:0:17767:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788748569.523599:0:17767:0:(import.c:65:import_set_state_nolock()) ffff99cf01940000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788748569.523605:0:17767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788748569.523607:0:17767:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788748569.523610:0:17767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788748569.525145:0:17767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147c600/0x5b377f42a7a7d1cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d1d3 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748569.525161:0:17767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147c600/0x5b377f42a7a7d1cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d1d3 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748569.525168:0:17767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cec147c600/0x5b377f42a7a7d1cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7d1d3 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748569.525175:0:17767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff99cec147c600/0x5b377f42a7a7d1cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7d1d3 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748569.525609:0:17767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748569.525619:0:17767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536e400/0x5b377f42a7a7d37e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d385 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748569.525627:0:17767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536e400/0x5b377f42a7a7d37e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d385 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748569.525633:0:17767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cee536e400/0x5b377f42a7a7d37e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7d385 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748569.525638:0:17767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff99cee536e400/0x5b377f42a7a7d37e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b377f42a7a7d385 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748569.525666:0:17767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788748569.525670:0:17767:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788748569.525687:0:17767:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788748569.525691:0:17767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788748569.525695:0:17767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788748569.525700:0:17767:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788748569.525703:0:17767:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff99ced2344d40) has no exports 00000020:00080000:2.0:1788748569.525738:0:17767:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff99ced2344d40) has no exports 00010000:00010000:0.0:1788748569.526661:0:15500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788748569.526670:0:15500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cec147c600/0x5b377f42a7a7d1cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7d1d3 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748569.526680:0:15500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec147c600 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:0.0:1788748569.526684:0:15500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cec147c600/0x5b377f42a7a7d1cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7d1d3 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748569.526694:0:15500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cec147c600/0x5b377f42a7a7d1cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b377f42a7a7d1d3 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788748569.526702:0:15500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cec147c600/0x5b377f42a7a7d1cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b377f42a7a7d1d3 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748569.526708:0:15500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788748569.526710:0:15500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1788748569.526713:0:15500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1788748569.526736:0:15500:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99ceecee9800 00010000:00010000:0.0:1788748569.526740:0:15500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cec147c600/0x5b377f42a7a7d1cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b377f42a7a7d1d3 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748569.526747:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cec147c600/0x5b377f42a7a7d1cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b377f42a7a7d1d3 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748569.526762:0:15500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748569.526765:0:15500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cee536e400/0x5b377f42a7a7d37e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7d385 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748569.526772:0:15500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cee536e400 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:0.0:1788748569.526785:0:15500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cee536e400/0x5b377f42a7a7d37e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b377f42a7a7d385 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748569.526792:0:15500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cee536e400/0x5b377f42a7a7d37e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b377f42a7a7d385 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788748569.526799:0:15500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cee536e400/0x5b377f42a7a7d37e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b377f42a7a7d385 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748569.526803:0:15500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788748569.526806:0:15500:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788748569.526807:0:15500:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788748569.526810:0:15500:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99ceecee9800 00010000:00010000:0.0:1788748569.526813:0:15500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cee536e400/0x5b377f42a7a7d37e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b377f42a7a7d385 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748569.526819:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cee536e400/0x5b377f42a7a7d37e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b377f42a7a7d385 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748569.526840:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748569.526842:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748569.526844:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748569.527839:0:14307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788748569.529213:0:17767:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ced1a67840 - data ffff99cedb35ebd0/ffff99cdc596b000 00000020:01000000:2.0:1788748569.529559:0:17767:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ced1a672a0 - data ffff99cef5a8c5e8/ffff99cdc5968800 00100000:10000000:2.0:1788748569.538801:0:17767:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788748569.553904:0:17767:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7d1e1 00000020:00000080:1.0:1788748569.553914:0:17767:0:(genops.c:885:class_export_put()) final put ffff99ceeceb9800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788748569.553962:0:17767:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cec6526800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788748569.553966:0:17767:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cec6526800 2 00000020:01000004:1.0:1788748569.553969:0:17767:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99cec6526800 from lustre-OST0001 00000020:00000080:1.0:1788748569.553991:0:17767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788748569.554001:0:17767:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788748569.554003:0:17767:0:(genops.c:885:class_export_put()) final put ffff99ceecebb800/lustre-OST0001_UUID 00000020:00000080:1.0:1788748569.554006:0:17767:0:(genops.c:844:class_export_destroy()) destroying export ffff99ceecebb800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788748569.554035:0:17767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788748569.554117:0:17767:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import e9f57890-027b-4d36-a4ce-36a41fae69fb->MGS 00010000:00010000:1.0:1788748569.554131:0:17767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99ceed6f9800/0x5b377f42a7a7d08a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b377f42a7a7d091 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748569.554143:0:17767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99ceed6f9800/0x5b377f42a7a7d08a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b377f42a7a7d091 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748569.554150:0:17767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788748569.554152:0:17767:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788748569.554155:0:17767:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788748569.554167:0:17767:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99ceecee9800 00010000:00010000:1.0:1788748569.554170:0:17767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99ceed6f9800/0x5b377f42a7a7d08a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b377f42a7a7d091 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748569.554192:0:17767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cee536e800/0x5b377f42a7a7cf72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b377f42a7a7cf79 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748569.554198:0:17767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cee536e800/0x5b377f42a7a7cf72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b377f42a7a7cf79 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748569.554204:0:17767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788748569.554206:0:17767:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788748569.554207:0:17767:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788748569.554216:0:17767:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99ceecee9800 00010000:00010000:1.0:1788748569.554218:0:17767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cee536e800/0x5b377f42a7a7cf72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b377f42a7a7cf79 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788748569.554233:0:17767:0:(import.c:65:import_set_state_nolock()) ffff99ceecee9800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788748569.554237:0:17767:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788748569.554239:0:17767:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788748569.554241:0:17767:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788748569.554245:0:17767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788748569.554256:0:17767:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cef76abb80 x1875638377101312/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788748576 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788748569.554273:0:17767:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788748569.554276:0:17767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:0.0:1788748569.554355:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e9f57890-027b-4d36-a4ce-36a41fae69fb:3305:1875638377101312:0@lo:250:ptlrpcd_00_01.0 10000000:01000000:1.0:1788748569.554454:0:17767:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788748569.554460:0:17767:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7cf5d 00000020:00000080:1.0:1788748569.554465:0:17767:0:(genops.c:885:class_export_put()) final put ffff99cdc4e1c000/e9f57890-027b-4d36-a4ce-36a41fae69fb 00000020:00000080:3.0:1788748569.554616:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99ceeceb9800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788748569.554668:0:17767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.104@tcp (flags='') 00000020:00000080:1.0:1788748569.554672:0:17767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788748569.554676:0:17767:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.104@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788748569.554680:0:17767:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff99ceece73380) has no exports 10000000:01000000:0.0:1788748569.554723:0:14316:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788748569.554783:0:17767:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.104@tcp: client import never connected 00000100:00080000:1.0:1788748569.554790:0:17767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788748569.554792:0:17767:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788748569.554794:0:17767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788748569.554796:0:17767:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788748569.554904:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99cdc4e1c000/e9f57890-027b-4d36-a4ce-36a41fae69fb for MGC192.168.203.104@tcp 00000020:00000080:1.0:1788748569.554988:0:17767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788748569.554993:0:17767:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.104@tcp (uuid e9f57890-027b-4d36-a4ce-36a41fae69fb) 00000020:01000000:1.0:1788748569.554997:0:17767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788748569.555000:0:17767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788748569.555003:0:17767:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788748569.555008:0:17767:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff99cf01943800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788748569.555034:0:17767:0:(genops.c:1552:class_disconnect_exports()) OBD device 17 (ffff99cefb8299c0) has exports, disconnecting them 00000020:00080000:1.0:1788748569.555039:0:17767:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff99cf01943800), last request at 1788748511 00000020:00000080:1.0:1788748569.555043:0:17767:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7d20b 00000020:00080000:1.0:1788748569.555051:0:17767:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cf01943800): rc 0 00000020:00000080:1.0:1788748569.555054:0:17767:0:(genops.c:885:class_export_put()) final put ffff99cf01943800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788748569.555175:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ceecee9800 for MGC192.168.203.104@tcp 00000020:00000080:3.0:1788748569.555181:0:37:0:(genops.c:885:class_export_put()) final put ffff99ceeceed800/e9f57890-027b-4d36-a4ce-36a41fae69fb 00000020:00000080:3.0:1788748569.555183:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99ceeceed800/e9f57890-027b-4d36-a4ce-36a41fae69fb for MGC192.168.203.104@tcp 00000020:01000000:3.0:1788748569.555187:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.104@tcp (e9f57890-027b-4d36-a4ce-36a41fae69fb) 00000020:00000080:3.0:1788748569.555605:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99cf01943800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788748569.556509:0:17767:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788748569.556515:0:17767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788748569.556519:0:17767:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788748569.556524:0:17767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788748569.556575:0:14306:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788748569.556653:0:15500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788748569.556897:0:14307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000020:00000080:3.0:1788748569.556962:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99cf01940000 for lustre-MDT0000-lwp-OST0001 00000100:00100000:3.0:1788748569.557084:0:14301:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff99cec2c5f800:14301] 0 exiting: rc = 1 00000100:00100000:3.0:1788748569.557129:0:14302:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff99cdc51e2600:14302] 1 exiting: rc = 0 00000100:00100000:1.0:1788748569.557205:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.557440:0:14303:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff99cefdbc7000:14303] 0 exiting: rc = 1 00000100:00100000:1.0:1788748569.557501:0:17617:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff99cef8f9d000:17617] 3 exiting: rc = 0 00000100:00100000:3.0:1788748569.557642:0:14304:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff99cefdbc6e00:14304] 1 exiting: rc = 0 00000100:00100000:3.0:1788748569.558154:0:14305:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff99cefb821400:14305] 2 exiting: rc = 0 00000100:00100000:1.0:1788748569.558241:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558248:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558257:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558264:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558271:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558276:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558281:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558297:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558311:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558316:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558321:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558327:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558332:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558336:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558341:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558346:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558351:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558356:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558361:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558366:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558370:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558375:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558379:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558384:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558388:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558392:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558398:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558403:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558408:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558413:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558417:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558423:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558428:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558433:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558439:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558444:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558448:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558453:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558457:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558463:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558468:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558473:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558485:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558491:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558496:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558501:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558506:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558526:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558532:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558537:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558543:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558548:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558553:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558570:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558575:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558581:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558587:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558592:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558597:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558602:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558608:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558613:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558618:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.558624:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788748569.559536:0:17767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788748569.559546:0:17767:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788748569.559551:0:17767:0:(genops.c:885:class_export_put()) final put ffff99ceeceb8800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788748569.559555:0:17767:0:(genops.c:844:class_export_destroy()) destroying export ffff99ceeceb8800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788748569.559560:0:17767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788748569.559596:0:17767:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cec6526800 1 00000020:00000080:1.0:1788748569.559602:0:17767:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5b377f42a7a7d1c5 00000020:00000080:1.0:1788748569.559608:0:17767:0:(genops.c:885:class_export_put()) final put ffff99cee5169000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788748569.559624:0:17767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788748569.559628:0:17767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788748569.559633:0:17767:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788748569.559636:0:17767:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff99cefb82cd40) has no exports 00000020:00000080:3.0:1788748569.559908:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99cee5169000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788748569.571433:0:17767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788748569.571450:0:17767:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788748569.571455:0:17767:0:(genops.c:885:class_export_put()) final put ffff99cec6524000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788748569.571459:0:17767:0:(genops.c:844:class_export_destroy()) destroying export ffff99cec6524000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788748569.571470:0:17767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788748569.571705:0:17767:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99cec6523000 00000020:01000000:3.0:1788748569.571730:0:17767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788748569.571735:0:17767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788748569.571739:0:17767:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788748569.571751:0:17767:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff99ced2343380) has no exports 00000020:00000080:3.0:1788748569.571776:0:17767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788748569.571782:0:17767:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788748569.571785:0:17767:0:(genops.c:885:class_export_put()) final put ffff99cefd850000/OSS_uuid 00000020:00000080:3.0:1788748569.571787:0:17767:0:(genops.c:844:class_export_destroy()) destroying export ffff99cefd850000/OSS_uuid for OSS 00000020:01000000:3.0:1788748569.571790:0:17767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1788748569.573855:0:15007:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff99ceed5d3400:15007] 2 exiting: rc = 0 00000100:00100000:1.0:1788748569.574583:0:15006:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff99cefd807800:15006] 1 exiting: rc = 0 00000100:00100000:1.0:1788748569.574638:0:15495:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff99cee53bfe00:15495] 3 exiting: rc = 0 00000100:00100000:1.0:1788748569.574686:0:15005:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff99cefd806e00:15005] 0 exiting: rc = 1 00000100:00100000:3.0:1788748569.574806:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.574815:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.574821:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.574826:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.574840:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.574845:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.574850:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.574856:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.574861:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.574868:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.574873:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.574878:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.574883:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.574889:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.574894:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.574899:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.574904:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.574909:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.574914:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.574921:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.574926:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.574931:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.574937:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.574942:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.574947:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.574952:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.574957:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.574962:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.574968:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.574991:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.574997:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575002:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575007:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575029:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575035:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575040:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575046:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575053:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575058:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575063:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575068:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575073:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575078:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575083:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575088:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575092:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575096:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575101:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575105:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575111:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575116:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575121:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575126:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575131:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575135:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575140:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575145:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575149:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575154:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575158:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575163:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575168:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575174:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.575179:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:0.0:1788748569.576114:0:14314:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788748569.576247:0:15009:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff99cef68cba00:15009] 1 exiting: rc = 0 00000100:00100000:0.0:1788748569.576313:0:15008:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff99cef68ca400:15008] 0 exiting: rc = 1 00000100:00100000:3.0:1788748569.576660:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576666:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576671:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576676:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576681:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576685:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576692:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576697:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576702:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576706:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576711:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576715:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576720:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576725:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576730:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576735:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576739:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576744:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576749:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576754:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576758:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576763:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576767:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576772:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576776:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576782:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576787:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576792:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576796:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576801:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576806:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576810:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576814:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576819:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576824:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576850:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576855:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576860:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576865:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576870:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576875:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576880:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576885:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576889:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576894:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576899:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576903:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576908:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576913:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576920:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576927:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576932:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576938:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576943:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576948:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576954:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576960:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576965:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576970:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576979:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576985:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576991:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.576995:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.577001:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.577820:0:16555:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_003: service thread [ffff99cdc4760200:16555] 3 exiting: rc = 0 00000100:00100000:3.0:1788748569.578291:0:15010:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff99cec8b5b600:15010] 0 exiting: rc = 1 00000100:00100000:1.0:1788748569.578515:0:15012:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff99cdc51e2e00:15012] 2 exiting: rc = 0 00000100:00100000:1.0:1788748569.578682:0:16556:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_004: service thread [ffff99cdc4761400:16556] 4 exiting: rc = 0 00000100:00100000:0.0:1788748569.579322:0:16557:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_005: service thread [ffff99cefdbd5600:16557] 5 exiting: rc = 0 00000100:00100000:0.0:1788748569.579505:0:15011:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff99cec8b5b400:15011] 1 exiting: rc = 0 00000100:00100000:3.0:1788748569.579754:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579762:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579768:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579783:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579798:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579804:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579810:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579815:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579820:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579826:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579840:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579846:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579853:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579858:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579864:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579869:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579874:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579880:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579885:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579891:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579897:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579902:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579907:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579912:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579917:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579923:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579928:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579947:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579954:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579960:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579965:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579971:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579976:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579982:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579987:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579993:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.579999:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.580004:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.580010:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.580088:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.580094:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.580100:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.580105:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.580111:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.580116:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.580121:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.580126:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.580132:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.580137:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.580142:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.580147:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.580163:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.580170:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.580175:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.580180:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.580186:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.580191:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.580197:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.580202:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.580208:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.580222:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.580229:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.580234:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.580240:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748569.584649:0:15013:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff99cdc51e3c00:15013] 0 exiting: rc = 1 00000100:00100000:2.0:1788748569.584948:0:15014:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff99cec8b5b800:15014] 1 exiting: rc = 0 00000100:00100000:3.0:1788748569.585334:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585342:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585347:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585352:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585357:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585362:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585367:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585372:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585377:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585384:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585400:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585404:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585409:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585414:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585418:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585423:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585428:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585432:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585438:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585444:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585449:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585454:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585459:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585464:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585469:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585477:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585482:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585487:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585492:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585499:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585505:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585510:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585515:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585520:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585525:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585530:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585536:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585541:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585556:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585562:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585567:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585573:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585579:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585585:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585590:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585602:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585608:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585613:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585618:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585623:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585627:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585632:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585637:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585641:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585646:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585650:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585657:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585663:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585668:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585673:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585678:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585682:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585687:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.585692:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.587396:0:15015:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff99cef754de00:15015] 0 exiting: rc = 1 00000100:00100000:0.0:1788748569.587649:0:15016:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff99cef754d600:15016] 1 exiting: rc = 0 00000100:00100000:3.0:1788748569.587781:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.587788:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.587794:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.587800:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.587823:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.587839:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.587846:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.587852:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.587858:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.587863:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.587869:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.587875:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.587881:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.587886:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.587892:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.587905:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.587923:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.587930:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.587936:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.587942:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.587947:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.587953:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.587959:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.587965:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.587970:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.587976:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.587981:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.587987:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588007:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588034:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588041:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588047:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588052:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588058:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588064:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588069:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588075:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588080:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588086:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588091:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588108:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588118:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588123:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588129:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588134:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588140:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588144:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588152:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588158:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588163:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588176:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588182:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588202:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588209:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588214:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588221:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588226:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588232:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588238:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588244:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588250:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588255:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588260:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748569.588265:0:17767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788748569.595247:0:17767:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1788748585.136345:0:18383:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788748593.112360:0:18844:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788748593.112365:0:18844:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788748593.112470:0:18844:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99cdc6438000 00000020:01000004:0.0:1788748593.112498:0:18844:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788748593.112506:0:18844:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788748593.112520:0:18844:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff99cefd4a19c0) 00000020:00000080:0.0:1788748593.112533:0:18844:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788748593.129187:0:18844:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788748593.137066:0:18844:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:0.0:1788748593.137700:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 457: rc = 0 00100000:10000000:0.0:1788748593.137802:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 457: rc = 0 00100000:10000000:0.0:1788748593.138928:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 457: rc = 0 00100000:10000000:0.0:1788748593.139047:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 457: rc = 0 00100000:10000000:0.0:1788748593.139148:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 457: rc = 0 00100000:10000000:0.0:1788748593.139335:0:18844:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788748593.140843:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 457: rc = 0 00100000:10000000:0.0:1788748593.141176:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 459: rc = 0 00100000:10000000:0.0:1788748593.146576:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 598: rc = 0 00100000:10000000:0.0:1788748593.147005:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 598: rc = 0 00100000:10000000:0.0:1788748593.147527:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 650: rc = 0 00100000:10000000:0.0:1788748593.148294:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 650: rc = 0 00100000:10000000:0.0:1788748593.148702:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 650: rc = 0 00100000:10000000:0.0:1788748593.148982:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 650: rc = 0 00100000:10000000:0.0:1788748593.149251:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 650: rc = 0 00100000:10000000:0.0:1788748593.152109:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 650: rc = 0 00100000:10000000:0.0:1788748593.152813:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 650: rc = 0 00100000:10000000:0.0:1788748593.153079:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 650: rc = 0 00100000:10000000:0.0:1788748593.153295:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 650: rc = 0 00100000:10000000:0.0:1788748593.154893:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 650: rc = 0 00100000:10000000:0.0:1788748593.156857:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 650: rc = 0 00100000:10000000:0.0:1788748593.157193:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 650: rc = 0 00100000:10000000:1.0:1788748593.159302:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 603: rc = 0 00100000:10000000:1.0:1788748593.159813:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 603: rc = 0 00100000:10000000:1.0:1788748593.160141:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 603: rc = 0 00100000:10000000:1.0:1788748593.160388:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 603: rc = 0 00100000:10000000:1.0:1788748593.161229:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 603: rc = 0 00100000:10000000:1.0:1788748593.161694:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 603: rc = 0 00100000:10000000:1.0:1788748593.161949:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 603: rc = 0 00100000:10000000:1.0:1788748593.162378:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 603: rc = 0 00100000:10000000:1.0:1788748593.163124:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 603: rc = 0 00100000:10000000:1.0:1788748593.164760:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 603: rc = 0 00100000:10000000:1.0:1788748593.165382:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 603: rc = 0 00100000:10000000:1.0:1788748593.165940:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 603: rc = 0 00100000:10000000:1.0:1788748593.168644:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 603: rc = 0 00100000:10000000:1.0:1788748593.168946:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 603: rc = 0 00100000:10000000:1.0:1788748593.169222:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 603: rc = 0 00100000:10000000:1.0:1788748593.169986:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 603: rc = 0 00100000:10000000:1.0:1788748593.170846:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 603: rc = 0 00100000:10000000:1.0:1788748593.171390:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 603: rc = 0 00100000:10000000:1.0:1788748593.172373:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 603: rc = 0 00100000:10000000:1.0:1788748593.173948:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 603: rc = 0 00100000:10000000:1.0:1788748593.174242:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 603: rc = 0 00100000:10000000:1.0:1788748593.175109:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 603: rc = 0 00100000:10000000:1.0:1788748593.175363:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 603: rc = 0 00100000:10000000:1.0:1788748593.176302:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 603: rc = 0 00100000:10000000:1.0:1788748593.176892:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 603: rc = 0 00100000:10000000:1.0:1788748593.177702:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 603: rc = 0 00100000:10000000:1.0:1788748593.177966:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 603: rc = 0 00100000:10000000:1.0:1788748593.180880:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 603: rc = 0 00100000:10000000:1.0:1788748593.182881:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 603: rc = 0 00100000:10000000:1.0:1788748593.183841:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 603: rc = 0 00100000:10000000:1.0:1788748593.184798:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 603: rc = 0 00100000:10000000:1.0:1788748593.186369:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 603: rc = 0 00100000:10000000:1.0:1788748593.187919:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 658: rc = 0 00100000:10000000:0.0:1788748593.195473:0:18844:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1788748593.195661:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 599: rc = 0 00100000:10000000:0.0:1788748593.195891:0:18844:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1788748593.195955:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 599: rc = 0 00100000:10000000:0.0:1788748593.196167:0:18844:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1788748593.196236:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 599: rc = 0 00100000:10000000:0.0:1788748593.196588:0:18844:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1788748593.196659:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 645: rc = 0 00100000:10000000:0.0:1788748593.196868:0:18844:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1788748593.196938:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 645: rc = 0 00100000:10000000:0.0:1788748593.197171:0:18844:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1788748593.197244:0:18844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 645: rc = 0 00000020:00000080:0.0:1788748593.197500:0:18844:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788748593.197507:0:18844:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788748593.197516:0:18844:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b377f42a7a7d63a 00000020:01000004:0.0:1788748593.197524:0:18844:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1788748593.197530:0:18844:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788748593.197535:0:18844:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99cdc6438000 from MGS 00000020:01000004:0.0:1788748593.197539:0:18844:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788748593.197548:0:18844:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff99cefd4a4d40) 00000020:00000080:0.0:1788748593.197559:0:18844:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788748593.197613:0:18844:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cdc6438000 from MGS, refs=2 00080000:01000000:0.0:1788748593.197618:0:18844:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788748593.197624:0:18844:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b377f42a7a7d648 00000100:00100000:0.0:1788748593.197735:0:18844:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788748593.197871:0:18844:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788748593.197883:0:18844:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788748593.214779:0:18844:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788748593.214793:0:18844:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788748593.215686:0:18844:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788748593.215860:0:18844:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788748593.215865:0:18844:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788748593.216980:0:18844:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788748593.216989:0:18844:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788748593.228554:0:18844:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788748593.228570:0:18844:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788748593.230314:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748593.230319:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748593.230321:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748593.230729:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748593.230731:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748593.230733:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748593.231217:0:18844:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788748593.233812:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788748593.244843:0:18844:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788748593.244861:0:18844:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788748593.244864:0:18844:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788748593.246795:0:18853:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788748593.246945:0:18844:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788748593.247072:0:18844:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788748593.247942:0:18844:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788748593.248247:0:18844:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788748593.248389:0:18844:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788748593.248394:0:18844:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788748593.255227:0:18844:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788748593.255241:0:18844:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788748593.257240:0:18844:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788748593.257253:0:18844:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788748593.258097:0:18844:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788748593.258117:0:18844:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.104@tcp' 00000020:01000004:0.0:1788748593.258119:0:18844:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788748593.258147:0:18844:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.104@tcp (typ=mgc) 00000020:00000080:0.0:1788748593.258159:0:18844:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.104@tcp (ffff99cefd4a3380) 00000020:00000080:0.0:1788748593.258173:0:18844:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788748593.258252:0:18844:0:(ldlm_lib.c:103:import_set_conn()) imp ffff99cef2bdd000@MGC192.168.203.104@tcp: add connection 192.168.203.104@tcp at head 00010000:00010000:0.0:1788748593.258397:0:18844:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.104@tcp-0 is initialized 00000040:01000000:0.0:1788748593.258402:0:18844:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788748593.258513:0:18858:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788748593.265747:0:18859:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788748593.267808:0:18844:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.104@tcp (uuid 0ddbae60-91f9-474f-9a47-689ab5e32951) 00000020:00000080:1.0:1788748593.267833:0:18844:0:(genops.c:1384:class_connect()) connect: client 0ddbae60-91f9-474f-9a47-689ab5e32951, cookie 0x5b377f42a7a7d656 00000100:00080000:1.0:1788748593.267846:0:18844:0:(import.c:545:import_select_connection()) MGC192.168.203.104@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788748593.267857:0:18844:0:(import.c:666:import_select_connection()) MGC192.168.203.104@tcp: import ffff99cef2bdd000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1788748593.267890:0:18844:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cef730f100 x1875638377101568/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788748593.267957:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0ddbae60-91f9-474f-9a47-689ab5e32951:3305:1875638377101568:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788748593.268037:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788748593.269290:0:18844:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 0ddbae60-91f9-474f-9a47-689ab5e32951->MGS 00000020:01000004:1.0:1788748593.269324:0:18844:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788748593.269330:0:18844:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788748593.269345:0:18844:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff99cdc4e23380) 00000020:00000080:1.0:1788748593.269359:0:18844:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788748593.272081:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377101568 00000100:00100000:3.0:1788748593.272095:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377101568 00000100:00100000:3.0:1788748593.272129:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788748593.272137:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee53eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1875638377101568:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788748593.272163:0:18854:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from 0ddbae60-91f9-474f-9a47-689ab5e32951@0@lo t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:3.0:1788748593.272187:0:18854:0:(genops.c:1384:class_connect()) connect: client 0ddbae60-91f9-474f-9a47-689ab5e32951, cookie 0x5b377f42a7a7d664 00000100:00080000:3.0:1788748593.272326:0:18854:0:(import.c:65:import_set_state_nolock()) ffff99cf01984000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788748593.278172:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee53eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+5:3305:x1875638377101568:12345-0@lo:250:mount.lustre.0 Request processed in 6026us (10125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748593.278193:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788748593.281170:0:3305:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.104@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788748593.281187:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.104@tcp: connect to target with instance 0 00000100:00080000:2.0:1788748593.281197:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788748593.281203:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788748593.281209:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99cef2bdd000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788748593.281212:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788748593.281233:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788748593.281249:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0ddbae60-91f9-474f-9a47-689ab5e32951:3305:1875638377101568:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788748593.285788:0:18844:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788748593.285995:0:18844:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788748593.286002:0:18844:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788748593.287438:0:18844:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788748593.287450:0:18844:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788748593.287859:0:18844:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788748593.287866:0:18844:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788748593.288553:0:18844:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788748593.288809:0:18844:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788748593.288815:0:18844:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788748593.289393:0:18844:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788748593.289402:0:18844:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788748593.354114:0:18844:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788748593.354320:0:18844:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788748593.354327:0:18844:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788748593.355881:0:18844:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788748593.355893:0:18844:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788748593.356748:0:18844:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788748593.356925:0:18844:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788748593.356931:0:18844:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788748593.357924:0:18844:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788748593.357933:0:18844:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788748593.358814:0:18844:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788748593.359204:0:18844:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788748593.359212:0:18844:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788748593.359913:0:18844:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788748593.359921:0:18844:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788748593.360580:0:18844:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788748593.360760:0:18844:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788748593.360765:0:18844:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788748593.363408:0:18844:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788748593.363429:0:18844:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788748593.386520:0:18844:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788748593.386802:0:18844:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788748593.386811:0:18844:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788748593.388775:0:18844:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788748593.388789:0:18844:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788748593.391420:0:18844:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788748593.391435:0:18844:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788748593.392310:0:18844:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788748593.392337:0:18844:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788748593.392343:0:18844:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788748593.392479:0:18844:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788748593.392515:0:18844:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.104@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788748593.392520:0:18844:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788748593.392521:0:18844:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788748593.392523:0:18844:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788748593.392524:0:18844:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788748593.392525:0:18844:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788748593.392527:0:18844:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788748593.392528:0:18844:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788748593.392529:0:18844:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788748593.392531:0:18844:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788748593.392532:0:18844:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788748593.392535:0:18844:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788748593.392536:0:18844:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788748593.392538:0:18844:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788748593.392539:0:18844:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788748593.392540:0:18844:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788748593.392546:0:18844:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788748593.392547:0:18844:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788748593.392548:0:18844:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788748593.392548:0:18844:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788748593.392549:0:18844:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788748593.392550:0:18844:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788748593.392577:0:18844:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788748593.392597:0:18844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7305c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:18844:1875638377101696:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788748593.392686:0:18844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748593.392745:0:18844:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed4a79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748593.392966:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377101696 00000100:00100000:0.0:1788748593.392974:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377101696 00000100:00100000:0.0:1788748593.393052:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788748593.393061:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee53e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+5:18844:x1875638377101696:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788748593.393116:0:18857:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788748593.393120:0:18857:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788748593.393123:0:18857:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788748593.393503:0:18878:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788748593.394251:0:18857:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 8 20000000:01000000:0.0:1788748593.398348:0:18879:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788748593.398358:0:18879:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788748593.398367:0:18879:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788748593.398410:0:18879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1788748593.398726:0:18857:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788748593.398738:0:18857:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788748593.431103:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee53e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+5:18844:x1875638377101696:12345-0@lo:253:mount.lustre.0 Request processed in 38035us (38408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748593.431122:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788748593.432911:0:18844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7305c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:18844:1875638377101696:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788748593.432932:0:18844:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788748593.432936:0:18844:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788748593.432938:0:18844:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788748593.432939:0:18844:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788748593.432941:0:18844:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788748593.432942:0:18844:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788748593.432944:0:18844:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788748593.432946:0:18844:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788748593.432947:0:18844:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788748593.432949:0:18844:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788748593.432950:0:18844:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788748593.433011:0:18844:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99cdc6438000 from lustre-MDT0000 10000000:01000000:0.0:1788748593.433121:0:18844:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788748593.433124:0:18844:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788748593.433386:0:18844:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff99cefd4a3380 10000000:01000000:0.0:1788748593.433393:0:18844:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788748593.433402:0:18844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99cefd4a3380 from 1 10000000:01000000:0.0:1788748593.433405:0:18844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788748593.433462:0:18844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e5400/0x5b377f42a7a7d66b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748593.433473:0:18844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ced13e5400/0x5b377f42a7a7d66b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748593.433483:0:18844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ced13e5400/0x5b377f42a7a7d66b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748593.433504:0:18844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:18844:1875638377101824:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788748593.433557:0:18844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748593.433715:0:18844:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec5003d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788748593.433913:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377101824 00000100:00100000:3.0:1788748593.433921:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377101824 00000100:00100000:3.0:1788748593.433968:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788748593.433977:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee53e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+5:18844:x1875638377101824:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788748593.433989:0:18856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748593.434005:0:18856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced7b42800/0x5b377f42a7a7d672 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d66b expref: -99 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748593.434052:0:18856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced7b42800/0x5b377f42a7a7d672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d66b expref: 6 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748593.434064:0:18856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced7b42800/0x5b377f42a7a7d672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d66b expref: 6 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748593.434072:0:18856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b42800, rc 0) 00000100:00100000:3.0:1788748593.434743:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee53e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+6:18844:x1875638377101824:12345-0@lo:101:mount.lustre.0 Request processed in 764us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748593.434751:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788748593.434886:0:18844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:18844:1875638377101824:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788748593.434905:0:18844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ced13e5400/0x5b377f42a7a7d66b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d672 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748593.434916:0:18844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ced13e5400/0x5b377f42a7a7d66b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d672 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748593.434976:0:18844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:18844:1875638377101952:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748593.435008:0:18844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748593.435233:0:18844:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec5003d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788748593.435270:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377101952 00000100:00100000:2.0:1788748593.435276:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377101952 00000100:00100000:2.0:1788748593.435351:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788748593.435360:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee53eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+6:18844:x1875638377101952:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788748593.435620:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee53eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+6:18844:x1875638377101952:12345-0@lo:501:mount.lustre.0 Request processed in 260us (609us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788748593.435628:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788748593.435815:0:18844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:18844:1875638377101952:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788748593.435843:0:18844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788748593.435868:0:18844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e5400/0x5b377f42a7a7d66b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d672 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748593.435878:0:18844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ced13e5400/0x5b377f42a7a7d66b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d672 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748593.435887:0:18844:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99cdc6438000 10000000:01000000:0.0:1788748593.435892:0:18844:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788748593.435897:0:18844:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99cdc6438000 10000000:01000000:0.0:1788748593.435900:0:18844:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788748593.435903:0:18844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff99cdc6438000 from 1 10000000:01000000:0.0:1788748593.435906:0:18844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788748593.435930:0:18844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e4400/0x5b377f42a7a7d679 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748593.435938:0:18844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ced13e4400/0x5b377f42a7a7d679 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748593.435954:0:18844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ced13e4400/0x5b377f42a7a7d679 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748593.435969:0:18844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:18844:1875638377102080:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788748593.435997:0:18844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748593.436306:0:18844:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec5003d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788748593.436348:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377102080 00000100:00100000:3.0:1788748593.436353:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377102080 00000100:00100000:1.0:1788748593.436410:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788748593.436430:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee53e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+6:18844:x1875638377102080:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788748593.436441:0:18856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748593.436458:0:18856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ceed6f9200/0x5b377f42a7a7d680 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d679 expref: -99 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748593.436478:0:18856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ceed6f9200/0x5b377f42a7a7d680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d679 expref: 7 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748593.436488:0:18856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ceed6f9200/0x5b377f42a7a7d680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d679 expref: 7 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748593.436497:0:18856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f9200, rc 0) 00000100:00100000:1.0:1788748593.436546:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee53e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+7:18844:x1875638377102080:12345-0@lo:101:mount.lustre.0 Request processed in 129us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748593.436553:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788748593.436679:0:18844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:18844:1875638377102080:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788748593.436693:0:18844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ced13e4400/0x5b377f42a7a7d679 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d680 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748593.436701:0:18844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ced13e4400/0x5b377f42a7a7d679 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d680 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748593.436713:0:18844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788748593.436728:0:18844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e4400/0x5b377f42a7a7d679 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d680 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748593.436734:0:18844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ced13e4400/0x5b377f42a7a7d679 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d680 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748593.436740:0:18844:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788748593.436744:0:18844:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788748593.436748:0:18844:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99cdc6438000 10000000:01000000:0.0:1788748593.436750:0:18844:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788748593.436753:0:18844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788748593.436755:0:18844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788748593.436772:0:18844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e5c00/0x5b377f42a7a7d687 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748593.436784:0:18844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ced13e5c00/0x5b377f42a7a7d687 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748593.436792:0:18844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ced13e5c00/0x5b377f42a7a7d687 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748593.436806:0:18844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:18844:1875638377102208:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788748593.436830:0:18844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748593.436843:0:18844:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec5003d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788748593.436955:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377102208 00000100:00100000:1.0:1788748593.436960:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377102208 00000100:00100000:1.0:1788748593.436980:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788748593.436985:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee53eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+7:18844:x1875638377102208:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788748593.436992:0:18856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748593.437001:0:18856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ceed6f8000/0x5b377f42a7a7d68e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d687 expref: -99 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748593.437041:0:18856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ceed6f8000/0x5b377f42a7a7d68e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d687 expref: 8 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748593.437050:0:18856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ceed6f8000/0x5b377f42a7a7d68e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d687 expref: 8 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748593.437056:0:18856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f8000, rc 0) 00000100:00100000:1.0:1788748593.437088:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee53eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+8:18844:x1875638377102208:12345-0@lo:101:mount.lustre.0 Request processed in 102us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748593.437094:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788748593.437290:0:18844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:18844:1875638377102208:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788748593.437302:0:18844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ced13e5c00/0x5b377f42a7a7d687 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d68e expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748593.437310:0:18844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ced13e5c00/0x5b377f42a7a7d687 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d68e expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748593.437354:0:18844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:18844:1875638377102336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748593.437380:0:18844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748593.437402:0:18844:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec5003d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788748593.437515:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377102336 00000100:00100000:1.0:1788748593.437520:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377102336 00000100:00100000:1.0:1788748593.437549:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788748593.437556:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee53eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+8:18844:x1875638377102336:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788748593.437932:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee53eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+9:18844:x1875638377102336:12345-0@lo:501:mount.lustre.0 Request processed in 376us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748593.437940:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788748593.438185:0:18844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:18844:1875638377102336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748593.438217:0:18844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:18844:1875638377102464:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788748593.438257:0:18844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748593.438277:0:18844:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec5003d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788748593.438391:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377102464 00000100:00100000:1.0:1788748593.438397:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377102464 00000100:00100000:1.0:1788748593.438574:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788748593.438584:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee53e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+9:18844:x1875638377102464:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788748593.438933:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee53e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+9:18844:x1875638377102464:12345-0@lo:503:mount.lustre.0 Request processed in 350us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748593.438941:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788748593.439095:0:18844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:18844:1875638377102464:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788748593.439726:0:18880:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76abb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ddbae60-91f9-474f-9a47-689ab5e32951:18880:1875638377102592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748593.439777:0:18880:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748593.439814:0:18880:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec5003a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788748593.439925:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377102592 00000100:00100000:3.0:1788748593.439932:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377102592 00000100:00100000:3.0:1788748593.439972:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788748593.439980:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+9:18880:x1875638377102592:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748593.440281:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+9:18880:x1875638377102592:12345-0@lo:502:llog_process_th.0 Request processed in 302us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748593.440289:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788748593.440534:0:18880:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76abb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ddbae60-91f9-474f-9a47-689ab5e32951:18880:1875638377102592:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788748593.440563:0:18880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748593.440573:0:18880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748593.440575:0:18880:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788748593.440581:0:18880:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788748593.440584:0:18880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788748593.440598:0:18880:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99cdc4e20000) 00000020:00000080:1.0:1788748593.440615:0:18880:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788748593.440621:0:18880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788748593.440766:0:18880:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788748593.440773:0:18880:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b377f42a7a7d69c 00000020:00000080:1.0:1788748593.440974:0:18880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788748593.440978:0:18880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748593.440982:0:18880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748593.440983:0:18880:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788748593.440986:0:18880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748593.440990:0:18880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748593.440991:0:18880:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788748593.440994:0:18880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788748593.441002:0:18880:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99cdc4e219c0) 00000020:00000080:1.0:1788748593.441011:0:18880:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788748593.441055:0:18880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788748593.441057:0:18880:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788748593.441060:0:18880:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788748593.441075:0:18880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788748593.441124:0:18880:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cdc6438000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788748593.441137:0:18880:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99cdc4e24d40) 00000020:00000080:1.0:1788748593.441212:0:18880:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788748593.441265:0:18880:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788748593.441271:0:18880:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b377f42a7a7d6b1 00000020:00000080:1.0:1788748593.441359:0:18880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788748593.441365:0:18880:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788748593.441370:0:18880:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5b377f42a7a7d6b8 00080000:01000000:1.0:1788748593.441375:0:18880:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788748593.441377:0:18880:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b377f42a7a7d6bf 00010000:00010000:3.0:1788748593.512220:0:18880:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788748593.513004:0:18880:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:3.0:1788748593.513701:0:18880:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788748593.514729:0:18880:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99cefb82cd40) 00000020:00000080:3.0:1788748593.514750:0:18880:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788748593.514899:0:18880:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788748593.514907:0:18880:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b377f42a7a7d6cd 00000020:00000080:1.0:1788748593.519188:0:18880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788748593.524933:0:18880:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5b377f42a7a7d6d4 00000020:00000080:1.0:1788748593.525604:0:18880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788748593.525616:0:18880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748593.525622:0:18880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748593.525624:0:18880:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788748593.525627:0:18880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788748593.525630:0:18880:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788748593.525631:0:18880:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788748593.525632:0:18880:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788748593.525634:0:18880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788748593.525648:0:18880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748593.525649:0:18880:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788748593.525652:0:18880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748593.525656:0:18880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748593.525657:0:18880:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788748593.525662:0:18880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788748593.525705:0:18880:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788748593.525719:0:18880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748593.525722:0:18880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748593.525724:0:18880:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788748593.525726:0:18880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788748593.525729:0:18880:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788748593.525740:0:18880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748593.525741:0:18880:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788748593.525745:0:18880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788748593.525750:0:18880:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:1.0:1788748593.525775:0:18880:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788748593.525777:0:18880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788748593.525792:0:18880:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99cee507b380) 00000020:00000080:1.0:1788748593.525806:0:18880:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788748593.525811:0:18880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788748593.525874:0:18880:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788748593.525880:0:18880:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788748593.525885:0:18880:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b377f42a7a7d6e2 00010000:00080000:1.0:1788748593.525916:0:18880:0:(ldlm_lib.c:103:import_set_conn()) imp ffff99ceecee9800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:1.0:1788748593.526384:0:18880:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1788748593.526816:0:18880:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788748593.526863:0:18880:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788748593.528504:0:18880:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788748593.528600:0:18880:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1788748593.528761:0:18880:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:3.0:1788748593.529500:0:18884:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788748593.529505:0:18884:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788748593.530832:0:18880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788748593.530846:0:18880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788748593.530878:0:18880:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788748593.530895:0:18880:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b377f42a7a7d6e9 00000100:00080000:3.0:1788748593.530906:0:18880:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788748593.530918:0:18880:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99ceecee9800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1788748593.530952:0:18880:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cee5195180 x1875638377102720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788748593.530983:0:18880:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788748593.531080:0:18880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748593.531084:0:18880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748593.531086:0:18880:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788748593.531089:0:18880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788748593.531382:0:18880:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1788748593.531385:0:18880:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788748593.531387:0:18880:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788748593.531389:0:18880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788748593.531393:0:18880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748593.531394:0:18880:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788748593.531402:0:18880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788748593.531406:0:18880:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788748593.531410:0:18880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748593.531411:0:18880:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788748593.531414:0:18880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788748593.531417:0:18880:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:3.0:1788748593.531437:0:18880:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788748593.531439:0:18880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788748593.531451:0:18880:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99cefb8299c0) 00000020:00000080:3.0:1788748593.531462:0:18880:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788748593.531466:0:18880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788748593.531519:0:18880:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788748593.531524:0:18880:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788748593.531530:0:18880:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b377f42a7a7d6f7 00010000:00080000:3.0:1788748593.531558:0:18880:0:(ldlm_lib.c:103:import_set_conn()) imp ffff99ced1419800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:3.0:1788748593.531890:0:18880:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788748593.532093:0:18880:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788748593.532115:0:18880:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1788748593.532275:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377102720:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788748593.532324:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875638377102720 offset 0 length 520: 4 00000040:00080000:1.0:1788748593.533474:0:18880:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788748593.533547:0:18880:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1788748593.533750:0:18880:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:2.0:1788748593.535357:0:18886:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788748593.535364:0:18886:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788748593.536267:0:18880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788748593.536281:0:18880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788748593.536315:0:18880:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788748593.536335:0:18880:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b377f42a7a7d6fe 00000100:00080000:0.0:1788748593.536345:0:18880:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788748593.536357:0:18880:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99ced1419800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1788748593.536394:0:18880:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cef76ab100 x1875638377102848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788748593.536466:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377102848:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788748593.536514:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875638377102848 offset 0 length 520: 4 00000100:00080000:0.0:1788748593.536569:0:18880:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788748593.536630:0:18880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748593.536645:0:18880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748593.536648:0:18880:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788748593.536652:0:18880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788748593.536656:0:18880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748593.536657:0:18880:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788748593.536660:0:18880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788748593.536662:0:18880:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788748593.536664:0:18880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748593.536666:0:18880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748593.536677:0:18880:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788748593.536681:0:18880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788748593.536684:0:18880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748593.536685:0:18880:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788748593.536689:0:18880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788748593.536720:0:18880:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ddbae60-91f9-474f-9a47-689ab5e32951:18880:1875638377102976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748593.536771:0:18880:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748593.536787:0:18880:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec875acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748593.537435:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377102976 00000100:00100000:3.0:1788748593.537443:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377102976 00000100:00100000:3.0:1788748593.537484:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788748593.537494:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+9:18880:x1875638377102976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748593.537757:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+9:18880:x1875638377102976:12345-0@lo:502:llog_process_th.0 Request processed in 264us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748593.537765:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788748593.537917:0:18880:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ddbae60-91f9-474f-9a47-689ab5e32951:18880:1875638377102976:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788748593.537945:0:18880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748593.537949:0:18880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748593.537951:0:18880:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788748593.537954:0:18880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788748593.538173:0:18844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1788748593.538191:0:18844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788748593.538211:0:18844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e5c00/0x5b377f42a7a7d687 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d68e expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748593.538221:0:18844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ced13e5c00/0x5b377f42a7a7d687 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d68e expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748593.538230:0:18844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99cdc6438000 from 1 10000000:01000000:3.0:1788748593.538233:0:18844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788748593.538264:0:18844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced7b42000/0x5b377f42a7a7d705 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748593.538272:0:18844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ced7b42000/0x5b377f42a7a7d705 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748593.538281:0:18844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ced7b42000/0x5b377f42a7a7d705 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748593.538298:0:18844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5194000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:18844:1875638377103104:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788748593.538330:0:18844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748593.538365:0:18844:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd83d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788748593.538474:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377103104 00000100:00100000:0.0:1788748593.538486:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377103104 00000100:00100000:0.0:1788748593.538520:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788748593.538528:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+9:18844:x1875638377103104:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788748593.538538:0:18857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748593.538551:0:18857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7d70c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d705 expref: -99 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748593.538571:0:18857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7d70c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d705 expref: 10 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748593.538581:0:18857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7d70c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d705 expref: 10 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748593.538589:0:18857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e5e00, rc 0) 00000100:00100000:0.0:1788748593.538619:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+10:18844:x1875638377103104:12345-0@lo:101:mount.lustre.0 Request processed in 92us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748593.538626:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788748593.538876:0:18844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5194000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:18844:1875638377103104:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788748593.538890:0:18844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ced7b42000/0x5b377f42a7a7d705 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d70c expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748593.538899:0:18844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ced7b42000/0x5b377f42a7a7d705 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d70c expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748593.539731:0:18844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5194000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:18844:1875638377103232:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788748593.539790:0:18844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748593.539828:0:18844:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd83d240 going to sleep for 11 seconds 00000100:00100000:3.0:1788748593.539850:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377103232 00000100:00100000:3.0:1788748593.539855:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377103232 00000100:00100000:3.0:1788748593.539897:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788748593.539905:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+10:18844:x1875638377103232:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788748593.539921:0:18854:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788748593.539927:0:18854:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788748593.540361:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+10:18844:x1875638377103232:12345-0@lo:256:mount.lustre.0 Request processed in 454us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748593.540369:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788748593.540412:0:18844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5194000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:18844:1875638377103232:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788748593.541435:0:18844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788748593.541496:0:18844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced7b42000/0x5b377f42a7a7d705 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d70c expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748593.541509:0:18844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ced7b42000/0x5b377f42a7a7d705 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d70c expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748593.541581:0:18844:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99cdc6438000 from 1 10000000:01000000:2.0:1788748593.541585:0:18844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788748593.541628:0:18844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cef6bde000/0x5b377f42a7a7d713 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748593.541657:0:18844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cef6bde000/0x5b377f42a7a7d713 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748593.541676:0:18844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cef6bde000/0x5b377f42a7a7d713 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748593.541696:0:18844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7304000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:18844:1875638377103360:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788748593.541749:0:18844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748593.541824:0:18844:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed4a79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748593.541960:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377103360 00000100:00100000:0.0:1788748593.542133:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377103360 00000100:00100000:0.0:1788748593.542276:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788748593.542286:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+10:18844:x1875638377103360:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788748593.542298:0:18857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748593.542313:0:18857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced13e5800/0x5b377f42a7a7d71a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d713 expref: -99 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748593.542335:0:18857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced13e5800/0x5b377f42a7a7d71a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d713 expref: 11 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748593.542344:0:18857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced13e5800/0x5b377f42a7a7d71a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d713 expref: 11 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748593.542361:0:18857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e5800, rc 0) 00000100:00100000:0.0:1788748593.542411:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+11:18844:x1875638377103360:12345-0@lo:101:mount.lustre.0 Request processed in 127us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748593.542418:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788748593.542493:0:18844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7304000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:18844:1875638377103360:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788748593.542507:0:18844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cef6bde000/0x5b377f42a7a7d713 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d71a expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748593.542516:0:18844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cef6bde000/0x5b377f42a7a7d713 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d71a expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748593.542563:0:18844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7304000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:18844:1875638377103488:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788748593.542588:0:18844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748593.542683:0:18844:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed4a79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748593.542811:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377103488 00000100:00100000:1.0:1788748593.542822:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377103488 00000100:00100000:1.0:1788748593.542846:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788748593.542853:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+11:18844:x1875638377103488:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788748593.543275:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+11:18844:x1875638377103488:12345-0@lo:501:mount.lustre.0 Request processed in 421us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748593.543282:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788748593.543424:0:18844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7304000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:18844:1875638377103488:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788748593.543456:0:18844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7304000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:18844:1875638377103616:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788748593.543493:0:18844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748593.543521:0:18844:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed4a79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748593.543630:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377103616 00000100:00100000:1.0:1788748593.543712:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377103616 00000100:00100000:1.0:1788748593.543736:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788748593.543742:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+11:18844:x1875638377103616:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788748593.543942:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+11:18844:x1875638377103616:12345-0@lo:503:mount.lustre.0 Request processed in 199us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748593.543949:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788748593.544313:0:18844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7304000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:18844:1875638377103616:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788748593.544707:0:18888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7304000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ddbae60-91f9-474f-9a47-689ab5e32951:18888:1875638377103744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788748593.544756:0:18888:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748593.544789:0:18888:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed4a7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788748593.544896:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377103744 00000100:00100000:0.0:1788748593.544902:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377103744 00000100:00100000:0.0:1788748593.544937:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788748593.544945:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+11:18888:x1875638377103744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748593.545186:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+11:18888:x1875638377103744:12345-0@lo:502:llog_process_th.0 Request processed in 241us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748593.545193:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788748593.545238:0:18888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7304000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ddbae60-91f9-474f-9a47-689ab5e32951:18888:1875638377103744:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788748593.545265:0:18888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788748593.545274:0:18888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748593.545276:0:18888:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788748593.545284:0:18888:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cdc6438000 00000020:00000080:0.0:1788748593.545286:0:18888:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788748593.545292:0:18888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748593.545295:0:18888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748593.545296:0:18888:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788748593.545299:0:18888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788748593.545301:0:18888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748593.545302:0:18888:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788748593.545305:0:18888:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cdc6438000 00000020:00000080:0.0:1788748593.545307:0:18888:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788748593.545355:0:18888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748593.545359:0:18888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748593.545365:0:18888:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788748593.545369:0:18888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788748593.545372:0:18888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748593.545373:0:18888:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788748593.545377:0:18888:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99cdc6438000 00000020:00000080:0.0:1788748593.545379:0:18888:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788748593.545415:0:18888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ddbae60-91f9-474f-9a47-689ab5e32951:18888:1875638377103872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748593.545448:0:18888:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748593.545467:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377103872 00000100:00100000:0.0:1788748593.545470:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377103872 00000100:00100000:0.0:1788748593.545488:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788748593.545494:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+11:18888:x1875638377103872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748593.545601:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+11:18888:x1875638377103872:12345-0@lo:502:llog_process_th.0 Request processed in 106us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748593.545607:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788748593.545835:0:18888:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec875a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788748593.545852:0:18888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ddbae60-91f9-474f-9a47-689ab5e32951:18888:1875638377103872:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788748593.545871:0:18888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748593.545876:0:18888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748593.545878:0:18888:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788748593.545881:0:18888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788748593.545932:0:18844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788748593.545947:0:18844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788748593.545974:0:18844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cef6bde000/0x5b377f42a7a7d713 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d71a expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748593.545985:0:18844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cef6bde000/0x5b377f42a7a7d713 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d71a expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748593.546058:0:18844:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788748593.546061:0:18844:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99cdc6438000 10000000:01000000:0.0:1788748593.546064:0:18844:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99cdc6438000 10000000:01000000:0.0:1788748593.546067:0:18844:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788748593.546072:0:18844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99cdc6438000 from 1 10000000:01000000:0.0:1788748593.546075:0:18844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788748593.546097:0:18844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e4200/0x5b377f42a7a7d721 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748593.546106:0:18844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ced13e4200/0x5b377f42a7a7d721 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748593.546115:0:18844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ced13e4200/0x5b377f42a7a7d721 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748593.546127:0:18844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:18844:1875638377104000:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788748593.546253:0:18844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748593.546275:0:18844:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec5003540 going to sleep for 11 seconds 00000100:00100000:0.0:1788748593.546290:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377104000 00000100:00100000:0.0:1788748593.546294:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377104000 00000100:00100000:0.0:1788748593.546314:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788748593.546321:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+11:18844:x1875638377104000:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788748593.546329:0:18856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748593.546341:0:18856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced13e5000/0x5b377f42a7a7d728 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d721 expref: -99 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748593.546361:0:18856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced13e5000/0x5b377f42a7a7d728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d721 expref: 12 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748593.546382:0:18856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced13e5000/0x5b377f42a7a7d728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d721 expref: 12 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748593.546390:0:18856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e5000, rc 0) 00000100:00100000:0.0:1788748593.546421:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+12:18844:x1875638377104000:12345-0@lo:101:mount.lustre.0 Request processed in 101us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748593.546427:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788748593.546459:0:18844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:18844:1875638377104000:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788748593.546470:0:18844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ced13e4200/0x5b377f42a7a7d721 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d728 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748593.546478:0:18844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ced13e4200/0x5b377f42a7a7d721 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d728 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748593.546515:0:18844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:18844:1875638377104128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748593.546538:0:18844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748593.546550:0:18844:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec5003540 going to sleep for 11 seconds 00000100:00100000:0.0:1788748593.546564:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377104128 00000100:00100000:0.0:1788748593.546567:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377104128 00000100:00100000:0.0:1788748593.546583:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788748593.546589:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+12:18844:x1875638377104128:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748593.546862:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+12:18844:x1875638377104128:12345-0@lo:501:mount.lustre.0 Request processed in 272us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748593.546869:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788748593.546901:0:18844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:18844:1875638377104128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748593.546947:0:18844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:18844:1875638377104256:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788748593.547291:0:18844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748593.547321:0:18844:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec5003540 going to sleep for 11 seconds 00000100:00100000:2.0:1788748593.547440:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377104256 00000100:00100000:2.0:1788748593.547445:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377104256 00000100:00100000:2.0:1788748593.547477:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788748593.547485:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+12:18844:x1875638377104256:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788748593.547752:0:18844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:18844:1875638377104256:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788748593.547951:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+12:18844:x1875638377104256:12345-0@lo:503:mount.lustre.0 Request processed in 466us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748593.547959:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788748593.556880:0:18889:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5194000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ddbae60-91f9-474f-9a47-689ab5e32951:18889:1875638377104384:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748593.557235:0:18889:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748593.557275:0:18889:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd83d240 going to sleep for 11 seconds 00000100:00100000:3.0:1788748593.557309:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377104384 00000100:00100000:3.0:1788748593.557315:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377104384 00000100:00100000:3.0:1788748593.557356:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788748593.557364:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2302050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+12:18889:x1875638377104384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748593.557624:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2302050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+12:18889:x1875638377104384:12345-0@lo:502:llog_process_th.0 Request processed in 259us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748593.557632:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788748593.558306:0:18889:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5194000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ddbae60-91f9-474f-9a47-689ab5e32951:18889:1875638377104384:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788748593.558367:0:18889:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788748593.558382:0:18889:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99cefb828000) 00000020:00000080:3.0:1788748593.558400:0:18889:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1788748593.558476:0:18889:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cdc6438000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788748593.558481:0:18889:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cdc6438000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788748593.558483:0:18889:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cdc6438000 4 00010000:00080000:3.0:1788748593.558520:0:18889:0:(ldlm_lib.c:103:import_set_conn()) imp ffff99cefd854000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:3.0:1788748593.565523:0:18889:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1788748593.567344:0:18889:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788748593.567386:0:18889:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788748593.567400:0:18889:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5b377f42a7a7d736 00000100:00080000:3.0:1788748593.567410:0:18889:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788748593.567421:0:18889:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99cefd854000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1788748593.567456:0:18889:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cee5194000 x1875638377104512/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788748593.567483:0:18889:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788748593.568262:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875638377104512:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788748593.568329:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748593.568753:0:18862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377104512 00000100:00100000:3.0:1788748593.568762:0:18862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377104512 00000100:00100000:3.0:1788748593.568793:0:18862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788748593.568800:0:18862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875638377104512:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788748593.568868:0:18862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875638377104512:12345-0@lo:38:llog_process_th.0 Request processed in 67us (539us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788748593.568875:0:18862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788748593.568997:0:18889:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5197800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ddbae60-91f9-474f-9a47-689ab5e32951:18889:1875638377104640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748593.569074:0:18889:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748593.569091:0:18889:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec48c6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788748593.569106:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377104640 00000100:00100000:3.0:1788748593.569110:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377104640 00000100:00100000:3.0:1788748593.569140:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788748593.569263:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+12:18889:x1875638377104640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748593.569490:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+12:18889:x1875638377104640:12345-0@lo:502:llog_process_th.0 Request processed in 229us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748593.569498:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788748593.569562:0:18889:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5197800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ddbae60-91f9-474f-9a47-689ab5e32951:18889:1875638377104640:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788748593.569589:0:18889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:1.0:1788748593.570087:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788748593.570095:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99cefd854000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788748593.570100:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788748593.570104:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875638377104512:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1788748593.570128:0:18844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788748593.570174:0:18844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788748593.570189:0:18844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e4200/0x5b377f42a7a7d721 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d728 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748593.570200:0:18844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ced13e4200/0x5b377f42a7a7d721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d728 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788748593.570252:0:18844:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788748593.570254:0:18844:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788748593.570255:0:18844:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788748593.570256:0:18844:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788748593.570258:0:18844:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788748593.570259:0:18844:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788748593.570261:0:18844:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788748593.570262:0:18844:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788748593.570264:0:18844:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788748593.570266:0:18844:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788748593.570270:0:18844:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788748593.570272:0:18844:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788748593.570274:0:18844:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788748593.570275:0:18844:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788748593.570276:0:18844:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788748593.570277:0:18844:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788748593.570278:0:18844:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788748593.570279:0:18844:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788748593.570280:0:18844:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788748593.570281:0:18844:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788748593.570282:0:18844:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788748593.570299:0:18844:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788748593.570310:0:18844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:18844:1875638377104768:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788748593.570347:0:18844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748593.570372:0:18844:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefd99a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788748593.570574:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377104768 00000100:00100000:3.0:1788748593.570580:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377104768 00000100:00100000:3.0:1788748593.570611:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788748593.571129:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2302450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+12:18844:x1875638377104768:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788748593.571166:0:18854:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788748593.571178:0:18854:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788748593.625374:0:18854:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788748593.625394:0:18854:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788748593.625621:0:18878:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788748593.625626:0:18878:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788748593.625658:0:18878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99cef6bdee00/0x5b377f42a7a7d73d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748593.625685:0:18878:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7d70c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d705 expref: 12 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748593.625694:0:18878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99cef6bdee00/0x5b377f42a7a7d73d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748593.625735:0:18878:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7d70c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7d705 expref: 12 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748593.625749:0:18878:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7d70c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7d705 expref: 12 pid: 18857 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748593.625763:0:18878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7304a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18878:1875638377104896:0@lo:104: 00000100:00100000:2.0:1788748593.625821:0:18878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748593.625866:0:18878:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cefff0a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748593.626223:0:18845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377104896 00000100:00100000:3.0:1788748593.626232:0:18845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377104896 00000100:00100000:3.0:1788748593.626269:0:18845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788748593.626278:0:18845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7307480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ddbae60-91f9-474f-9a47-689ab5e32951+3:18878:x1875638377104896:12345-0@lo:104: 00010000:00010000:3.0:1788748593.626292:0:18845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99ced7b42000/0x5b377f42a7a7d705 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7d70c expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748593.626350:0:18845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788748593.626363:0:18845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7307480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ddbae60-91f9-474f-9a47-689ab5e32951+3:18878:x1875638377104896:12345-0@lo:104: Request processed in 86us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748593.626371:0:18845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788748593.626393:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748593.626399:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99ced7b42000/0x5b377f42a7a7d705 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7d70c expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748593.626406:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b42000 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:3.0:1788748593.626410:0:18851:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99ced7b42000/0x5b377f42a7a7d705 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7d70c expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748593.626419:0:18851:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99ced7b42000/0x5b377f42a7a7d705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7d70c expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788748593.626426:0:18851:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99ced7b42000/0x5b377f42a7a7d705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7d70c expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748593.626432:0:18851:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788748593.626463:0:18851:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99ced7b42000/0x5b377f42a7a7d705 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d70c expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748593.626470:0:18851:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788748593.626490:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99ced7b42000/0x5b377f42a7a7d705 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d70c expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748593.626497:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99ced7b42000/0x5b377f42a7a7d705 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d70c expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748593.626514:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748593.626516:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748593.626518:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748593.626546:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ddbae60-91f9-474f-9a47-689ab5e32951:3306:1875638377105024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788748593.626576:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748593.626659:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377105024 00000100:00100000:3.0:1788748593.626664:0:18847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377105024 00010000:00010000:3.0:1788748593.626693:0:18847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7d70c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7d705 expref: 13 pid: 18857 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748593.626714:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788748593.626721:0:18847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5195f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ddbae60-91f9-474f-9a47-689ab5e32951+13:3306:x1875638377105024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788748593.626732:0:18847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748593.626737:0:18847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7d70c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7d705 expref: 13 pid: 18857 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748593.626747:0:18847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7d70c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7d705 expref: 13 pid: 18857 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748593.626762:0:18847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99cef6bdee00/0x5b377f42a7a7d73d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748593.626770:0:18847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cef6bdee00/0x5b377f42a7a7d73d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788748593.626783:0:18847:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001157566s 00010000:00010000:3.0:1788748593.626787:0:18847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cef6bdee00/0x5b377f42a7a7d73d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748593.626795:0:18847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cef6bdee00/0x5b377f42a7a7d73d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748593.626802:0:18847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99cef6bdee00/0x5b377f42a7a7d73d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748593.626818:0:18847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99cef6bdee00/0x5b377f42a7a7d73d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748593.626824:0:18847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cef6bdee00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748593.626828:0:18847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99cef6bdee00/0x5b377f42a7a7d73d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748593.626836:0:18847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99cef6bdee00/0x5b377f42a7a7d73d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748593.626845:0:18847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99cef6bdee00/0x5b377f42a7a7d73d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748593.626855:0:18847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748593.626885:0:18847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5195f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ddbae60-91f9-474f-9a47-689ab5e32951+13:3306:x1875638377105024:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748593.626892:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788748593.626928:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ddbae60-91f9-474f-9a47-689ab5e32951:3306:1875638377105024:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788748593.626956:0:18878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced13e5e00/0x5b377f42a7a7d70c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7d705 expref: 12 pid: 18857 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748593.627257:0:18878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7304a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18878:1875638377104896:0@lo:104: 00010000:00010000:3.0:1788748593.627274:0:18878:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99cef6bdee00/0x5b377f42a7a7d73d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748593.627309:0:18878:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99cef6bdee00/0x5b377f42a7a7d73d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748593.627328:0:18878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99cef6bdee00/0x5b377f42a7a7d73d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748593.627333:0:18878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cef6bdee00/0x5b377f42a7a7d73d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748593.632600:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2302450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+11:18844:x1875638377104768:12345-0@lo:253:mount.lustre.0 Request processed in 61469us (62243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748593.632615:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788748593.632809:0:18844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:18844:1875638377104768:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788748593.632826:0:18844:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788748593.632830:0:18844:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788748593.632831:0:18844:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788748593.632833:0:18844:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788748593.632834:0:18844:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788748593.632835:0:18844:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788748593.632837:0:18844:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788748593.632838:0:18844:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788748593.632840:0:18844:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788748593.632851:0:18844:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788748593.632853:0:18844:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788748593.632867:0:18844:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788748593.639875:0:18844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788748593.640316:0:18844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788748593.640603:0:18844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788748593.640848:0:18844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788748593.641390:0:18844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788748593.641555:0:18844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788748593.642711:0:18844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788748593.642895:0:18844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788748593.643502:0:18844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788748593.643864:0:18844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788748593.644337:0:18844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788748593.644497:0:18844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1788748593.685611:0:18844:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:2.0:1788748593.686312:0:18844:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788748593.688055:0:18900:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:3.0:1788748593.688065:0:18900:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:0.0:1788748593.688485:0:18901:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1788748593.688610:0:18901:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788748593.691770:0:18901:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788748593.691860:0:18901:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788748593.691864:0:18901:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1788748593.694883:0:18844:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788748593.695121:0:18844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788748593.695806:0:18844:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788748593.695816:0:18844:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788748593.696067:0:18844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788748593.698081:0:18844:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788748593.698889:0:18844:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788748593.698936:0:18844:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788748593.699851:0:18844:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:1.0:1788748593.701512:0:18844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:1.0:1788748593.709347:0:18844:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1788748593.779997:0:18844:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788748593.780067:0:18844:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb6f542a0f988 00100000:10000000:1.0:1788748593.780076:0:18844:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788748593.780991:0:18844:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788748593.781007:0:18844:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788748593.781054:0:18844:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788748593.781071:0:18844:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1788748594.292432:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788748594.605240:0:18897:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788748594.605251:0:18897:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788748594.605656:0:18897:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788748594.605698:0:18897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:0.0:1788748594.733133:0:18859:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788748594.733141:0:18859:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99cdc6438000 from 9 10000000:01000000:0.0:1788748594.733146:0:18859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788748594.733207:0:18859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e4c00/0x5b377f42a7a7d744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748594.733219:0:18859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ced13e4c00/0x5b377f42a7a7d744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748594.733234:0:18859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ced13e4c00/0x5b377f42a7a7d744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748594.733260:0:18859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377105152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788748594.733337:0:18859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748594.733487:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377105152 00000100:00100000:3.0:1788748594.733495:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377105152 00000100:00100000:3.0:1788748594.733543:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788748594.733553:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+11:18859:x1875638377105152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748594.733568:0:18856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748594.733583:0:18856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced7b42600/0x5b377f42a7a7d74b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d744 expref: -99 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748594.733607:0:18856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced7b42600/0x5b377f42a7a7d74b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d744 expref: 12 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748594.733618:0:18856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced7b42600/0x5b377f42a7a7d74b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d744 expref: 12 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748594.733627:0:18856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b42600, rc 0) 00000100:00100000:3.0:1788748594.733689:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+12:18859:x1875638377105152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748594.733696:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788748594.733820:0:18859:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec849a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788748594.733841:0:18859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377105152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788748594.733857:0:18859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ced13e4c00/0x5b377f42a7a7d744 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d74b expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748594.733872:0:18859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ced13e4c00/0x5b377f42a7a7d744 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d74b expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748594.733918:0:18859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377105280:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788748594.733947:0:18859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748594.733964:0:18859:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec849a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788748594.734247:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377105280 00000100:00100000:3.0:1788748594.734252:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377105280 00000100:00100000:3.0:1788748594.734288:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788748594.734295:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+12:18859:x1875638377105280:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788748594.734308:0:18854:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788748594.734324:0:18854:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788748594.734327:0:18854:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1788748594.734412:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+12:18859:x1875638377105280:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748594.734420:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788748594.734493:0:18859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377105280:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788748594.734541:0:18859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788748594.734549:0:18859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e4c00/0x5b377f42a7a7d744 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d74b expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748594.734558:0:18859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ced13e4c00/0x5b377f42a7a7d744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d74b expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748595.310197:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788748595.633301:0:18897:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788748595.633310:0:18897:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788748595.633340:0:18897:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788748595.633347:0:18897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788748596.336202:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748597.362760:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788748597.693120:0:19144:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788748598.381871:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788748599.024116:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788748599.024125:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788748599.024128:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788748599.024131:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788748599.024134:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788748599.024138:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788748599.024143:0:37:0:(import.c:65:import_set_state_nolock()) ffff99cefd854000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788748599.024166:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99cefd854000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1788748599.024195:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cef76a8e00 x1875638377105536/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788748599.024340:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ddbae60-91f9-474f-9a47-689ab5e32951:3307:1875638377105408:0@lo:400:kworker.0 00000100:00100000:3.0:1788748599.024428:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748599.026293:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875638377105536:0@lo:38:kworker.0 00000100:00100000:1.0:1788748599.026380:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748599.026613:0:18864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377105536 00000100:00100000:3.0:1788748599.026623:0:18864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377105536 00000100:00100000:3.0:1788748599.026863:0:18864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788748599.026873:0:18864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1875638377105536:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788748599.026916:0:18864:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 516 last 0 00000100:00100000:0.0:1788748599.026933:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377105408 00000100:00100000:0.0:1788748599.026939:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377105408 00000100:00100000:1.0:1788748599.027115:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788748599.027124:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2302850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+12:3307:x1875638377105408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748599.027197:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2302850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+12:3307:x1875638377105408:12345-0@lo:400:kworker.0 Request processed in 74us (2769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748599.027203:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788748599.027260:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ddbae60-91f9-474f-9a47-689ab5e32951:3307:1875638377105408:0@lo:400:kworker.0 00000020:00000080:3.0:1788748599.029827:0:18864:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5b377f42a7a7d752 00000004:00100000:3.0:1788748599.029860:0:18864:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788748599.031788:0:18864:0:(import.c:65:import_set_state_nolock()) ffff99cefb0a9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788748599.031923:0:18864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875638377105536:12345-0@lo:38:kworker.0 Request processed in 5047us (5540us total) trans 0 rc 0/0 00010000:00080000:0.0:1788748599.032347:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99cef76a8e00 x1875638377105536/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788748609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788748599.032368:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788748599.032379:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788748599.032385:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788748599.032399:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99cefd854000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788748599.032406:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875638377105536:0@lo:38:kworker.0 00000100:00100000:3.0:1788748599.032783:0:18864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788748599.405602:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748600.429365:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788748600.706004:0:19295:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb3cc6bb0 20000000:00000080:1.0:1788748600.706044:0:19295:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99cefa839000 uarg=0000000000000000 20000000:01000000:1.0:1788748600.706077:0:19295:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788748600.706083:0:19295:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788748600.706089:0:19295:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788748600.708536:0:19296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1788748600.708791:0:19295:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788748600.716974:0:19295:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788748600.717043:0:19295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99cef6bdfc00/0x5b377f42a7a7d759 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748600.717068:0:19295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ced13e5800/0x5b377f42a7a7d71a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d713 expref: 11 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748600.717077:0:19295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99cef6bdfc00/0x5b377f42a7a7d759 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748600.717665:0:19295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ced13e5800/0x5b377f42a7a7d71a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7d713 expref: 11 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748600.717705:0:19295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ced13e5800/0x5b377f42a7a7d71a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7d713 expref: 11 pid: 18857 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748600.717724:0:19295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7307b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19295:1875638377105664:0@lo:104: 00000100:00100000:2.0:1788748600.717813:0:19295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748600.718162:0:19295:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec32e7900 going to sleep for 11 seconds 00000100:00100000:1.0:1788748600.720874:0:18846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377105664 00000100:00100000:1.0:1788748600.720889:0:18846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377105664 00000100:00100000:1.0:1788748600.721075:0:18846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788748600.721090:0:18846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7304380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ddbae60-91f9-474f-9a47-689ab5e32951+3:19295:x1875638377105664:12345-0@lo:104: 00010000:00010000:1.0:1788748600.721109:0:18846:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99cef6bde000/0x5b377f42a7a7d713 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7d71a expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748600.721224:0:18846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788748600.721231:0:18846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7304380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ddbae60-91f9-474f-9a47-689ab5e32951+3:19295:x1875638377105664:12345-0@lo:104: Request processed in 147us (3417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748600.721238:0:18846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788748600.721260:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748600.721276:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cef6bde000/0x5b377f42a7a7d713 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7d71a expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748600.721289:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cef6bde000 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:2.0:1788748600.721294:0:18851:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cef6bde000/0x5b377f42a7a7d713 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7d71a expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748600.721306:0:18851:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cef6bde000/0x5b377f42a7a7d713 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7d71a expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748600.721315:0:18851:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cef6bde000/0x5b377f42a7a7d713 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7d71a expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748600.721321:0:18851:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788748600.721389:0:18851:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cef6bde000/0x5b377f42a7a7d713 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d71a expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748600.721396:0:18851:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748600.721435:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cef6bde000/0x5b377f42a7a7d713 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d71a expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748600.721443:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cef6bde000/0x5b377f42a7a7d713 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d71a expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748600.721479:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748600.721481:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748600.721483:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748600.721655:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ddbae60-91f9-474f-9a47-689ab5e32951:3308:1875638377105792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748600.721701:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748600.721817:0:19295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7307b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19295:1875638377105664:0@lo:104: 00000100:00100000:0.0:1788748600.721965:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377105792 00000100:00100000:0.0:1788748600.721970:0:18847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377105792 00010000:00010000:0.0:1788748600.721997:0:18847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ced13e5800/0x5b377f42a7a7d71a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7d713 expref: 12 pid: 18857 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748600.722048:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788748600.722056:0:18847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ddbae60-91f9-474f-9a47-689ab5e32951+12:3308:x1875638377105792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788748600.722067:0:18847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748600.722071:0:18847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ced13e5800/0x5b377f42a7a7d71a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7d713 expref: 12 pid: 18857 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748600.722082:0:18847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ced13e5800/0x5b377f42a7a7d71a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7d713 expref: 12 pid: 18857 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748600.722099:0:18847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced13e5800/0x5b377f42a7a7d71a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7d713 expref: 12 pid: 18857 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748600.722114:0:18847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99cef6bdfc00/0x5b377f42a7a7d759 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748600.722122:0:18847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cef6bdfc00/0x5b377f42a7a7d759 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748600.722138:0:18847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cef6bdfc00/0x5b377f42a7a7d759 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748600.722145:0:18847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cef6bdfc00/0x5b377f42a7a7d759 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748600.722161:0:18847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99cef6bdfc00/0x5b377f42a7a7d759 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748600.722167:0:18847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99cef6bdfc00/0x5b377f42a7a7d759 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748600.723006:0:19295:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99cef6bdfc00/0x5b377f42a7a7d759 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748600.723048:0:19295:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff99cef6bdfc00/0x5b377f42a7a7d759 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748600.723055:0:19295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99cef6bdfc00/0x5b377f42a7a7d759 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748600.725729:0:18847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cef6bdfc00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748600.725740:0:18847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99cef6bdfc00/0x5b377f42a7a7d759 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748600.725755:0:18847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99cef6bdfc00/0x5b377f42a7a7d759 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748600.725873:0:18847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99cef6bdfc00/0x5b377f42a7a7d759 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748600.725883:0:18847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cef6bdfc00/0x5b377f42a7a7d759 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748600.725904:0:18847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748600.725983:0:18847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ddbae60-91f9-474f-9a47-689ab5e32951+11:3308:x1875638377105792:12345-0@lo:103:ldlm_bl.0 Request processed in 3924us (4278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748600.725993:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788748600.726264:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ddbae60-91f9-474f-9a47-689ab5e32951:3308:1875638377105792:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788748601.453350:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788748602.224109:0:18859:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788748602.224115:0:18859:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99cdc6438000 from 10 10000000:01000000:0.0:1788748602.224119:0:18859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788748602.224160:0:18859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e4000/0x5b377f42a7a7d760 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748602.224182:0:18859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ced13e4000/0x5b377f42a7a7d760 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748602.224201:0:18859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ced13e4000/0x5b377f42a7a7d760 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748602.224227:0:18859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377105920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788748602.224286:0:18859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748602.224329:0:18859:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec5003540 going to sleep for 11 seconds 00000100:00100000:1.0:1788748602.224575:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377105920 00000100:00100000:1.0:1788748602.224584:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377105920 00000100:00100000:1.0:1788748602.224648:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788748602.224658:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+11:18859:x1875638377105920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748602.224672:0:18856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748602.224697:0:18856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ceed6f9400/0x5b377f42a7a7d767 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d760 expref: -99 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748602.224722:0:18856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ceed6f9400/0x5b377f42a7a7d767 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d760 expref: 12 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748602.224734:0:18856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ceed6f9400/0x5b377f42a7a7d767 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d760 expref: 12 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748602.224743:0:18856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f9400, rc 0) 00000100:00100000:1.0:1788748602.224797:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+12:18859:x1875638377105920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748602.224804:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788748602.224959:0:18859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377105920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748602.224975:0:18859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ced13e4000/0x5b377f42a7a7d760 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d767 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748602.224984:0:18859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ced13e4000/0x5b377f42a7a7d760 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d767 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748602.225062:0:18859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5197800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377106048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748602.225091:0:18859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748602.225115:0:18859:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec48c2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788748602.225236:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377106048 00000100:00100000:0.0:1788748602.225241:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377106048 00000100:00100000:0.0:1788748602.225276:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788748602.225284:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2301c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+12:18859:x1875638377106048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788748602.225521:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2301c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+12:18859:x1875638377106048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748602.225528:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788748602.225561:0:18859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5197800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377106048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788748602.225593:0:18859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377106176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788748602.225639:0:18859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748602.225653:0:18859:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cee5a7fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788748602.225665:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377106176 00000100:00100000:0.0:1788748602.225669:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377106176 00000100:00100000:0.0:1788748602.225687:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788748602.225693:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+12:18859:x1875638377106176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788748602.225827:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+12:18859:x1875638377106176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748602.225840:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788748602.225874:0:18859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377106176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788748602.226487:0:19359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788748602.226533:0:18859:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788748602.226567:0:18859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788748602.226577:0:18859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e4000/0x5b377f42a7a7d760 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d767 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748602.226587:0:18859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ced13e4000/0x5b377f42a7a7d760 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d767 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748602.482098:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748603.117546:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788748593/real 1788748593] req@ffff99cef76ab100 x1875638377102848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748603 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748603.117577:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99cef76ab100 x1875638377102848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748603 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748603.117588:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788748593/real 1788748593] req@ffff99cee5195180 x1875638377102720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748603 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748603.117599:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99cee5195180 x1875638377102720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748603 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788748603.117625:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99ced1419800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788748603.117646:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788748603.117650:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377102848:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788748603.117656:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99ceecee9800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788748603.117661:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788748603.117664:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377102720:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788748603.117756:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ddbae60-91f9-474f-9a47-689ab5e32951:3309:1875638377106304:0@lo:400:kworker.0 00000100:00100000:2.0:1788748603.117820:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788748603.117886:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788748603.117899:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788748603.117902:0:37:0:(import.c:65:import_set_state_nolock()) ffff99ceecee9800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788748603.117908:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 510 00000100:00080000:3.0:1788748603.117913:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788748603.117933:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99ceecee9800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1788748603.117954:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cee5195500 x1875638377106432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788748603.117979:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788748603.117982:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788748603.117984:0:37:0:(import.c:65:import_set_state_nolock()) ffff99ced1419800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788748603.117987:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 510 00000100:00080000:3.0:1788748603.117990:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788748603.117994:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99ced1419800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1788748603.118006:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cee5195c00 x1875638377106560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788748603.118084:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377106688:0@lo:400:kworker.0 00000100:00100000:3.0:1788748603.118121:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748603.118164:0:18863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377106688 00000100:00100000:3.0:1788748603.118171:0:18863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377106688 00000100:00100000:3.0:1788748603.118211:0:18863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788748603.118220:0:18863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377106688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748603.118266:0:18863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377106688:12345-0@lo:400:kworker.0 Request processed in 47us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748603.118273:0:18863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788748603.118307:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99cee5194380 x1875638377106688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748603.118318:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377106688:0@lo:400:kworker.0 00000100:00100000:3.0:1788748603.118333:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377106432:0@lo:8:kworker.0 00000400:00000100:3.0:1788748603.118363:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875638377106432 offset 0 length 520: 4 00000100:00100000:3.0:1788748603.118376:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377106560:0@lo:8:kworker.0 00000400:00000100:3.0:1788748603.118389:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875638377106560 offset 0 length 520: 4 00000100:00100000:0.0:1788748603.118443:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377106304 00000100:00100000:0.0:1788748603.118449:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377106304 00000100:00100000:0.0:1788748603.118484:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788748603.118491:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+12:3309:x1875638377106304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748603.126302:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+12:3309:x1875638377106304:12345-0@lo:400:kworker.0 Request processed in 7800us (8470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748603.126316:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788748603.127040:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ddbae60-91f9-474f-9a47-689ab5e32951:3309:1875638377106304:0@lo:400:kworker.0 00010000:00010000:3.0:1788748603.502724:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748604.527349:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788748605.242161:0:19545:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788748605.242165:0:19545:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788748605.242267:0:19545:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99cec6633000 00000020:01000004:2.0:1788748605.242283:0:19545:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788748605.242294:0:19545:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788748605.242307:0:19545:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff99ced23419c0) 00000020:00000080:2.0:1788748605.242323:0:19545:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788748605.259495:0:19545:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788748605.259766:0:19545:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788748605.261270:0:19545:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788748605.264383:0:19545:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788748605.264809:0:19545:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:3.0:1788748605.265307:0:19545:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:3.0:1788748605.268955:0:19545:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:3.0:1788748605.269312:0:19545:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:3.0:1788748605.269868:0:19545:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 768: rc = 0 00100000:10000000:3.0:1788748605.270925:0:19545:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 768: rc = 0 00100000:10000000:3.0:1788748605.271359:0:19545:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:3.0:1788748605.273347:0:19545:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 768: rc = 0 00100000:10000000:3.0:1788748605.273674:0:19545:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 768: rc = 0 00100000:10000000:3.0:1788748605.273930:0:19545:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 768: rc = 0 00000020:00000080:3.0:1788748605.274849:0:19545:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788748605.274860:0:19545:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788748605.274870:0:19545:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5b377f42a7a7d775 00000020:01000004:3.0:1788748605.274878:0:19545:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788748605.274898:0:19545:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.104@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788748605.274902:0:19545:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788748605.274908:0:19545:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788748605.274912:0:19545:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788748605.274930:0:19545:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff99cefb82b380) 00000020:00000080:3.0:1788748605.274940:0:19545:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788748605.279880:0:19545:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788748605.281542:0:19545:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788748605.281552:0:19545:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788748605.289580:0:19545:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788748605.289605:0:19545:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788748605.293565:0:19545:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788748605.293578:0:19545:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788748605.295872:0:19545:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788748605.296307:0:19545:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788748605.296314:0:19545:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788748605.296835:0:19545:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788748605.296843:0:19545:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788748605.330959:0:19545:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788748605.332006:0:19545:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788748605.332040:0:19545:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788748605.335272:0:19545:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788748605.335291:0:19545:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788748605.343191:0:19545:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788748605.343209:0:19545:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788748605.350662:0:19545:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788748605.350854:0:19545:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788748605.350860:0:19545:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788748605.351750:0:19545:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788748605.351760:0:19545:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788748605.412556:0:19545:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788748605.413003:0:19545:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788748605.413012:0:19545:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788748605.415819:0:19545:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788748605.415840:0:19545:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788748605.423193:0:19545:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788748605.423225:0:19545:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788748605.423231:0:19545:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788748605.436797:0:19545:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788748605.436844:0:19545:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.104@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788748605.436849:0:19545:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788748605.436851:0:19545:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788748605.436852:0:19545:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788748605.436853:0:19545:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788748605.436854:0:19545:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788748605.436855:0:19545:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788748605.436857:0:19545:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788748605.436859:0:19545:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788748605.436860:0:19545:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788748605.436864:0:19545:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788748605.436866:0:19545:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788748605.436867:0:19545:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788748605.436869:0:19545:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788748605.436870:0:19545:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788748605.436871:0:19545:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788748605.436872:0:19545:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788748605.436873:0:19545:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788748605.436874:0:19545:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788748605.436875:0:19545:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788748605.436901:0:19545:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788748605.436922:0:19545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377106816:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788748605.436986:0:19545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748605.437151:0:19545:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced1a0e840 going to sleep for 11 seconds 00000100:00100000:2.0:1788748605.437342:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377106816 00000100:00100000:2.0:1788748605.437350:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377106816 00000100:00100000:2.0:1788748605.437474:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788748605.437484:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2301450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+12:19545:x1875638377106816:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788748605.437513:0:18854:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788748605.437517:0:18854:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788748605.437520:0:18854:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788748605.444295:0:19545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377106816:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788748605.444314:0:19545:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788748605.444318:0:19545:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788748605.444320:0:19545:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788748605.444321:0:19545:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788748605.444323:0:19545:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788748605.444338:0:19545:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788748605.444339:0:19545:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788748605.444341:0:19545:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788748605.444342:0:19545:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788748605.444344:0:19545:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000100:00100000:3.0:1788748605.444447:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2301450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+12:19545:x1875638377106816:12345-0@lo:253:mount.lustre.0 Request processed in 6962us (7458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748605.444459:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000020:01000004:1.0:1788748605.444575:0:19545:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99cec6633000 from lustre-OST0000 10000000:01000000:1.0:1788748605.444610:0:19545:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788748605.444613:0:19545:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788748605.444620:0:19545:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99cefd4a3380 local copy 00010000:00010000:1.0:1788748605.444631:0:19545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e5400/0x5b377f42a7a7d66b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d672 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748605.444848:0:19545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377106944:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788748605.444887:0:19545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748605.444959:0:19545:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced1a0e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748605.445008:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377106944 00000100:00100000:0.0:1788748605.445032:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377106944 00000100:00100000:0.0:1788748605.445082:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788748605.445091:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2301850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+12:19545:x1875638377106944:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748605.445539:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2301850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+12:19545:x1875638377106944:12345-0@lo:501:mount.lustre.0 Request processed in 448us (650us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788748605.445547:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788748605.445631:0:19545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377106944:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788748605.445646:0:19545:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788748605.445791:0:19545:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788748605.445799:0:19545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e5400/0x5b377f42a7a7d66b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d672 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748605.445810:0:19545:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ced13e5400/0x5b377f42a7a7d66b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d672 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748605.445831:0:19545:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99cec6633000 10000000:01000000:1.0:1788748605.445836:0:19545:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788748605.445841:0:19545:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff99cefd4a3380 10000000:01000000:1.0:1788748605.445843:0:19545:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788748605.445847:0:19545:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff99cefd4a3380 from 1 10000000:01000000:1.0:1788748605.445850:0:19545:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788748605.445877:0:19545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceed6f9c00/0x5b377f42a7a7d783 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748605.445892:0:19545:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ceed6f9c00/0x5b377f42a7a7d783 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748605.445902:0:19545:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ceed6f9c00/0x5b377f42a7a7d783 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748605.445917:0:19545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377107072:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788748605.445944:0:19545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748605.446007:0:19545:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced1a0e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748605.446240:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377107072 00000100:00100000:0.0:1788748605.446246:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377107072 00000100:00100000:0.0:1788748605.446280:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788748605.446288:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+12:19545:x1875638377107072:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788748605.446299:0:18854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748605.446313:0:18854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced13e5800/0x5b377f42a7a7d78a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d783 expref: -99 pid: 18854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748605.446336:0:18854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced13e5800/0x5b377f42a7a7d78a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d783 expref: 13 pid: 18854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748605.446347:0:18854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced13e5800/0x5b377f42a7a7d78a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d783 expref: 13 pid: 18854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748605.446356:0:18854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e5800, rc 0) 00000100:00100000:0.0:1788748605.446560:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+13:19545:x1875638377107072:12345-0@lo:101:mount.lustre.0 Request processed in 272us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748605.446568:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788748605.446632:0:19545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377107072:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788748605.446647:0:19545:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ceed6f9c00/0x5b377f42a7a7d783 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d78a expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748605.446657:0:19545:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ceed6f9c00/0x5b377f42a7a7d783 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d78a expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748605.446672:0:19545:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788748605.446723:0:19545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceed6f9c00/0x5b377f42a7a7d783 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d78a expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748605.446732:0:19545:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ceed6f9c00/0x5b377f42a7a7d783 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d78a expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748605.446738:0:19545:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788748605.446742:0:19545:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788748605.446747:0:19545:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788748605.446749:0:19545:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788748605.446772:0:19545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8400/0x5b377f42a7a7d791 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748605.446779:0:19545:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8400/0x5b377f42a7a7d791 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748605.446788:0:19545:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8400/0x5b377f42a7a7d791 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748605.446803:0:19545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377107200:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788748605.446829:0:19545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748605.446861:0:19545:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced1a0e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748605.446923:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377107200 00000100:00100000:2.0:1788748605.446928:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377107200 00000100:00100000:2.0:1788748605.446961:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788748605.446969:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2300c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+13:19545:x1875638377107200:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788748605.446977:0:18857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748605.446987:0:18857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cef6bde600/0x5b377f42a7a7d798 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d791 expref: -99 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748605.447002:0:18857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cef6bde600/0x5b377f42a7a7d798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d791 expref: 14 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748605.447011:0:18857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cef6bde600/0x5b377f42a7a7d798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d791 expref: 14 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748605.447056:0:18857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cef6bde600, rc 0) 00000100:00100000:2.0:1788748605.447097:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2300c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+14:19545:x1875638377107200:12345-0@lo:101:mount.lustre.0 Request processed in 129us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748605.447103:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788748605.447186:0:19545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377107200:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788748605.447196:0:19545:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8400/0x5b377f42a7a7d791 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d798 expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748605.447203:0:19545:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8400/0x5b377f42a7a7d791 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d798 expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788748605.447868:0:19545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1788748605.449446:0:19545:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788748605.449726:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788748605.449771:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1788748605.449808:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1788748605.449859:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1788748605.449911:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1788748605.449945:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1788748605.449994:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1788748605.450079:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1788748605.450116:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1788748605.450202:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1788748605.450241:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1788748605.450291:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1788748605.450351:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1788748605.450358:0:19545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1788748605.450451:0:19545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377107328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788748605.450512:0:19545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748605.450548:0:19545:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced1a0ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788748605.450824:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377107328 00000100:00100000:3.0:1788748605.450832:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377107328 00000100:00100000:3.0:1788748605.450883:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788748605.450892:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd83a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+14:19545:x1875638377107328:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788748605.451269:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd83a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+14:19545:x1875638377107328:12345-0@lo:501:mount.lustre.0 Request processed in 377us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748605.451277:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788748605.451693:0:19545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377107328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788748605.451735:0:19545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377107456:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788748605.451781:0:19545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748605.451811:0:19545:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced1a0ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788748605.451860:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377107456 00000100:00100000:3.0:1788748605.451865:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377107456 00000100:00100000:3.0:1788748605.451936:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788748605.451944:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd83a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+14:19545:x1875638377107456:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788748605.452299:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd83a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+14:19545:x1875638377107456:12345-0@lo:503:mount.lustre.0 Request processed in 355us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748605.452308:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788748605.452698:0:19545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377107456:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788748605.453344:0:19545:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788748605.453492:0:19545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377107584:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788748605.453550:0:19545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748605.453963:0:19545:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced1a0ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788748605.454229:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377107584 00000100:00100000:0.0:1788748605.454236:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377107584 00000100:00100000:0.0:1788748605.454280:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788748605.454288:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd838050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+14:19545:x1875638377107584:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788748605.454545:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd838050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+14:19545:x1875638377107584:12345-0@lo:502:mount.lustre.0 Request processed in 257us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748605.454553:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788748605.454651:0:19545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377107584:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788748605.454898:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788748605.454949:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1788748605.454984:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1788748605.455078:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1788748605.455307:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1788748605.455347:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788748605.455399:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788748605.455437:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788748605.455474:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1788748605.455537:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1788748605.455575:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1788748605.455638:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1788748605.455676:0:19545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377107712:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788748605.455735:0:19545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748605.455768:0:19545:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced1a0ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788748605.455923:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377107712 00000100:00100000:0.0:1788748605.455930:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377107712 00000100:00100000:0.0:1788748605.455963:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788748605.455972:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd838450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+14:19545:x1875638377107712:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788748605.456381:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd838450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+14:19545:x1875638377107712:12345-0@lo:502:mount.lustre.0 Request processed in 408us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748605.456390:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788748605.456557:0:19545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377107712:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788748605.456644:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1788748605.456655:0:19545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1788748605.457957:0:19559:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788748605.457968:0:19559:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788748605.457974:0:19559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748605.457977:0:19559:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788748605.457984:0:19559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788748605.457999:0:19559:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff99cee5078000) 00000020:00000080:1.0:1788748605.458248:0:19559:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788748605.458257:0:19559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788748605.458336:0:19559:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cec6633000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788748605.458344:0:19559:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788748605.458351:0:19559:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5b377f42a7a7d7a6 00010000:00010000:1.0:1788748605.463571:0:19559:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1788748605.464188:0:19559:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934593 00080000:10000000:1.0:1788748605.466003:0:19559:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:1.0:1788748605.467685:0:19559:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788748605.467697:0:19559:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748605.467703:0:19559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748605.467705:0:19559:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788748605.467708:0:19559:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788748605.467710:0:19559:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788748605.467712:0:19559:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788748605.467714:0:19559:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788748605.467722:0:19559:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788748605.467725:0:19559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748605.467726:0:19559:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788748605.467730:0:19559:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748605.467733:0:19559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748605.467735:0:19559:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788748605.467738:0:19559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788748605.467740:0:19559:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788748605.467742:0:19559:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748605.467745:0:19559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748605.467746:0:19559:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788748605.467749:0:19559:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748605.467751:0:19559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748605.467752:0:19559:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788748605.467755:0:19559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788748605.467810:0:19559:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748605.467814:0:19559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748605.467815:0:19559:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788748605.467819:0:19559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:0.0:1788748605.467968:0:19545:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788748605.467994:0:19545:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788748605.468036:0:19545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8400/0x5b377f42a7a7d791 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d798 expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748605.468049:0:19545:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8400/0x5b377f42a7a7d791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d798 expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748605.468057:0:19545:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99cec6633000 from 1 10000000:01000000:0.0:1788748605.468070:0:19545:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788748605.468107:0:19545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7d7ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748605.468115:0:19545:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7d7ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748605.468125:0:19545:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7d7ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748605.468154:0:19545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377107840:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788748605.468222:0:19545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748605.468265:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377107840 00000100:00100000:0.0:1788748605.468272:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377107840 00000100:00100000:0.0:1788748605.468312:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788748605.468320:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd83bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+14:19545:x1875638377107840:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788748605.468333:0:18854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748605.468346:0:18854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced13e5a00/0x5b377f42a7a7d7b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d7ad expref: -99 pid: 18854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748605.468381:0:18854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced13e5a00/0x5b377f42a7a7d7b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d7ad expref: 15 pid: 18854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748605.468392:0:18854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced13e5a00/0x5b377f42a7a7d7b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d7ad expref: 15 pid: 18854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748605.468401:0:18854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e5a00, rc 0) 00000100:00100000:0.0:1788748605.468433:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd83bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+15:19545:x1875638377107840:12345-0@lo:101:mount.lustre.0 Request processed in 113us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748605.468439:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788748605.468475:0:19545:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceece1bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788748605.468496:0:19545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377107840:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788748605.468509:0:19545:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7d7ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d7b4 expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748605.468517:0:19545:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7d7ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d7b4 expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788748605.469007:0:19545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:0.0:1788748605.469455:0:19545:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788748605.469699:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788748605.469741:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1788748605.469786:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1788748605.469817:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1788748605.469851:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1788748605.469896:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1788748605.469933:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1788748605.469966:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1788748605.470061:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1788748605.470070:0:19545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:0.0:1788748605.470775:0:19545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377107968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748605.470837:0:19545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748605.470879:0:19545:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceece1bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788748605.470931:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377107968 00000100:00100000:1.0:1788748605.470938:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377107968 00000100:00100000:1.0:1788748605.470984:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788748605.470993:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd839c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+15:19545:x1875638377107968:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788748605.471280:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd839c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+15:19545:x1875638377107968:12345-0@lo:501:mount.lustre.0 Request processed in 288us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748605.471288:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788748605.471506:0:19545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377107968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788748605.471554:0:19545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5194380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377108096:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788748605.471605:0:19545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748605.471644:0:19545:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed615180 going to sleep for 11 seconds 00000100:00100000:0.0:1788748605.471714:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377108096 00000100:00100000:0.0:1788748605.471719:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377108096 00000100:00100000:0.0:1788748605.471753:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788748605.471760:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd83ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+15:19545:x1875638377108096:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788748605.471899:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd83ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+15:19545:x1875638377108096:12345-0@lo:503:mount.lustre.0 Request processed in 139us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748605.471906:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788748605.471987:0:19545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5194380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377108096:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788748605.473221:0:19545:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788748605.473310:0:19545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5194380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377108224:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788748605.473491:0:19545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748605.475856:0:19545:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed615180 going to sleep for 11 seconds 00000100:00100000:0.0:1788748605.478602:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377108224 00000100:00100000:0.0:1788748605.478617:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377108224 00000100:00100000:0.0:1788748605.478671:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788748605.478681:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd839450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+15:19545:x1875638377108224:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788748605.478934:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd839450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+15:19545:x1875638377108224:12345-0@lo:502:mount.lustre.0 Request processed in 254us (5566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748605.478949:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788748605.480621:0:19545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5194380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377108224:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788748605.480914:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788748605.480974:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1788748605.481052:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1788748605.481103:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1788748605.481151:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1788748605.481195:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1788748605.481228:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1788748605.481259:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:1.0:1788748605.481300:0:19545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377108352:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788748605.481386:0:19545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748605.481426:0:19545:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced1a0ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788748605.481630:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377108352 00000100:00100000:0.0:1788748605.481637:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377108352 00000100:00100000:0.0:1788748605.481684:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788748605.481693:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd83b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+15:19545:x1875638377108352:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788748605.481880:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd83b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+15:19545:x1875638377108352:12345-0@lo:502:mount.lustre.0 Request processed in 187us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748605.481888:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788748605.481990:0:19545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377108352:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788748605.482359:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1788748605.482448:0:19545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788748605.484005:0:19563:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748605.484126:0:19563:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748605.484129:0:19563:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788748605.484138:0:19563:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cec6633000 00000020:00000080:1.0:1788748605.484141:0:19563:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788748605.484148:0:19563:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748605.484151:0:19563:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748605.484152:0:19563:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788748605.484154:0:19563:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748605.484157:0:19563:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748605.484158:0:19563:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788748605.484161:0:19563:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cec6633000 00000020:00000080:1.0:1788748605.484164:0:19563:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788748605.484205:0:19563:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748605.484208:0:19563:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748605.484210:0:19563:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788748605.484212:0:19563:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748605.484215:0:19563:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748605.484216:0:19563:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788748605.484220:0:19563:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99cec6633000 00000020:00000080:1.0:1788748605.484222:0:19563:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788748605.484265:0:19563:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748605.484269:0:19563:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748605.484270:0:19563:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788748605.484273:0:19563:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:0.0:1788748605.494353:0:19545:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788748605.494412:0:19545:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788748605.494428:0:19545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7d7ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d7b4 expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748605.494441:0:19545:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7d7ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d7b4 expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748605.494585:0:19545:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788748605.494598:0:19545:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99cec6633000 10000000:01000000:0.0:1788748605.494601:0:19545:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99cec6633000 10000000:01000000:0.0:1788748605.494605:0:19545:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788748605.494611:0:19545:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99cec6633000 from 1 10000000:01000000:0.0:1788748605.494614:0:19545:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788748605.494653:0:19545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e4a00/0x5b377f42a7a7d7bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748605.494662:0:19545:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ced13e4a00/0x5b377f42a7a7d7bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748605.494671:0:19545:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ced13e4a00/0x5b377f42a7a7d7bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748605.494707:0:19545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377108480:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788748605.494774:0:19545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748605.494809:0:19545:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceece1bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788748605.494982:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377108480 00000100:00100000:1.0:1788748605.494989:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377108480 00000100:00100000:1.0:1788748605.495051:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788748605.495416:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd83b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+15:19545:x1875638377108480:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788748605.495431:0:18856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748605.495445:0:18856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ceed6f9000/0x5b377f42a7a7d7c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d7bb expref: -99 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748605.495469:0:18856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ceed6f9000/0x5b377f42a7a7d7c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d7bb expref: 16 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748605.495479:0:18856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ceed6f9000/0x5b377f42a7a7d7c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d7bb expref: 16 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748605.495488:0:18856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f9000, rc 0) 00000100:00100000:1.0:1788748605.495529:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd83b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+16:19545:x1875638377108480:12345-0@lo:101:mount.lustre.0 Request processed in 471us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748605.495536:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788748605.495812:0:19545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377108480:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788748605.495828:0:19545:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ced13e4a00/0x5b377f42a7a7d7bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d7c2 expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748605.495838:0:19545:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ced13e4a00/0x5b377f42a7a7d7bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d7c2 expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788748605.498191:0:19545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:0.0:1788748605.499335:0:19545:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788748605.500551:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788748605.500624:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1788748605.500658:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1788748605.500714:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1788748605.500752:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1788748605.500796:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1788748605.500833:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1788748605.500865:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1788748605.500910:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788748605.500943:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1788748605.500977:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1788748605.502515:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1788748605.502621:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1788748605.502660:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1788748605.502730:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1788748605.502767:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1788748605.502802:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1788748605.502883:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1788748605.502922:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1788748605.502961:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1788748605.503038:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1788748605.504630:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1788748605.504695:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1788748605.504763:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1788748605.504798:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:0.0:1788748605.504829:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:0.0:1788748605.504881:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:0.0:1788748605.504915:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:0.0:1788748605.504946:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:0.0:1788748605.504990:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:0.0:1788748605.506684:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:0.0:1788748605.506757:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:0.0:1788748605.506791:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:0.0:1788748605.506879:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:0.0:1788748605.506918:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:0.0:1788748605.506967:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:0.0:1788748605.507004:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:0.0:1788748605.507055:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:0.0:1788748605.507118:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:0.0:1788748605.507155:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:0.0:1788748605.507252:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:0.0:1788748605.507260:0:19545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:0.0:1788748605.507379:0:19545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377108608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748605.507445:0:19545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748605.507496:0:19545:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceece1bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788748605.507576:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377108608 00000100:00100000:1.0:1788748605.507584:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377108608 00000100:00100000:1.0:1788748605.507640:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788748605.507649:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd839050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+16:19545:x1875638377108608:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788748605.507874:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd839050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+16:19545:x1875638377108608:12345-0@lo:501:mount.lustre.0 Request processed in 225us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748605.507882:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788748605.508650:0:19545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377108608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748605.508692:0:19545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377108736:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788748605.508745:0:19545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748605.508778:0:19545:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceece1bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788748605.510200:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377108736 00000100:00100000:1.0:1788748605.510213:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377108736 00000100:00100000:1.0:1788748605.510269:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788748605.510279:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd83b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+16:19545:x1875638377108736:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788748605.510601:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd83b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+16:19545:x1875638377108736:12345-0@lo:503:mount.lustre.0 Request processed in 324us (1855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748605.510609:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788748605.510825:0:19545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377108736:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788748605.511630:0:19545:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788748605.511710:0:19545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377108864:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788748605.511771:0:19545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748605.511808:0:19545:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceece1bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788748605.513999:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377108864 00000100:00100000:1.0:1788748605.514033:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377108864 00000100:00100000:1.0:1788748605.514094:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788748605.514104:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd838850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+16:19545:x1875638377108864:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788748605.514481:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd838850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+16:19545:x1875638377108864:12345-0@lo:502:mount.lustre.0 Request processed in 377us (2708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748605.514490:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788748605.514899:0:19545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377108864:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788748605.516624:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788748605.516713:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1788748605.516755:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1788748605.516817:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1788748605.516863:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788748605.516944:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788748605.516991:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788748605.518527:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788748605.518642:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788748605.518681:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788748605.518718:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788748605.518772:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788748605.518809:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1788748605.518844:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1788748605.518889:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1788748605.518922:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1788748605.518950:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1788748605.518990:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1788748605.519629:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1788748605.519679:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1788748605.519746:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1788748605.519818:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1788748605.519857:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1788748605.519918:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1788748605.519961:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:0.0:1788748605.519999:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:0.0:1788748605.520257:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:0.0:1788748605.520300:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:0.0:1788748605.520342:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:0.0:1788748605.520480:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:0.0:1788748605.520542:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:0.0:1788748605.520579:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:0.0:1788748605.520635:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:0.0:1788748605.520687:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:0.0:1788748605.520724:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:0.0:1788748605.520792:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:0.0:1788748605.520831:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:0.0:1788748605.520890:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:0.0:1788748605.520948:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:0.0:1788748605.520984:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:0.0:1788748605.521476:0:19545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377108992:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788748605.521556:0:19545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748605.522260:0:19545:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceece1bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788748605.522494:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377108992 00000100:00100000:2.0:1788748605.522502:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377108992 00000100:00100000:2.0:1788748605.522585:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788748605.522604:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd83a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+16:19545:x1875638377108992:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788748605.522854:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd83a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+16:19545:x1875638377108992:12345-0@lo:502:mount.lustre.0 Request processed in 252us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748605.522862:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788748605.524303:0:19545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377108992:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788748605.524458:0:19545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:1.0:1788748605.524474:0:19545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788748605.526939:0:19568:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788748605.526955:0:19568:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff99cefd4a0000) 00000020:00000080:0.0:1788748605.526977:0:19568:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788748605.527097:0:19568:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cec6633000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788748605.527102:0:19568:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cec6633000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788748605.527105:0:19568:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cec6633000 3 00010000:00080000:0.0:1788748605.527138:0:19568:0:(ldlm_lib.c:103:import_set_conn()) imp ffff99cdc4e1e800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.104@tcp at head 00010000:00010000:1.0:1788748605.535252:0:19568:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1788748605.535657:0:19568:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788748605.535699:0:19568:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788748605.535712:0:19568:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5b377f42a7a7d7d0 00000100:00080000:1.0:1788748605.535722:0:19568:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788748605.535734:0:19568:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cdc4e1e800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1788748605.535786:0:19568:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cef730c000 x1875638377109120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788748605.535864:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875638377109120:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788748605.535928:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748605.536050:0:18864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377109120 00000100:00100000:0.0:1788748605.536059:0:18864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377109120 00000100:00100000:0.0:1788748605.536106:0:18864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788748605.536114:0:18864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1875638377109120:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788748605.536137:0:18864:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:0.0:1788748605.536171:0:18864:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5b377f42a7a7d7d7 00000004:00100000:0.0:1788748605.536186:0:18864:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788748605.536217:0:18864:0:(import.c:65:import_set_state_nolock()) ffff99cdc4e1d000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788748605.536295:0:19568:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788748605.536318:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788748605.536339:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788748605.536341:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788748605.536344:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788748605.536460:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377109248:0@lo:400:kworker.0 00000100:00100000:1.0:1788748605.536492:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748605.536616:0:18862:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788748605.536625:0:18862:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788748605.536794:0:18862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377109248 00000100:00100000:3.0:1788748605.536799:0:18862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377109248 00000100:00100000:3.0:1788748605.536829:0:18862:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788748605.536837:0:18862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788748605.536845:0:18862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377109248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748605.536897:0:18862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377109248:12345-0@lo:400:kworker.0 Request processed in 53us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748605.536905:0:18862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788748605.536942:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99cef730ea00 x1875638377109248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748605.536956:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377109248:0@lo:400:kworker.0 00000100:00100000:0.0:1788748605.537116:0:18864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875638377109120:12345-0@lo:38:llog_process_th.0 Request processed in 1000us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748605.537124:0:18864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788748605.537271:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99cef730c000 x1875638377109120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788748615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748605.537280:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788748605.537287:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1788748605.537293:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788748605.537297:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788748605.537299:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99cdc4e1e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788748605.537305:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875638377109120:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788748605.537674:0:19568:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:0.0:1788748605.537851:0:19545:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788748605.537877:0:19545:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788748605.537898:0:19545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e4a00/0x5b377f42a7a7d7bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d7c2 expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748605.537910:0:19545:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ced13e4a00/0x5b377f42a7a7d7bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d7c2 expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788748605.537958:0:19545:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788748605.537961:0:19545:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788748605.537962:0:19545:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788748605.537964:0:19545:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788748605.537965:0:19545:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788748605.537967:0:19545:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788748605.537968:0:19545:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788748605.537970:0:19545:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788748605.537972:0:19545:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788748605.537975:0:19545:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788748605.537977:0:19545:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788748605.537978:0:19545:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788748605.537979:0:19545:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788748605.537981:0:19545:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788748605.537983:0:19545:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788748605.537991:0:19545:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788748605.537992:0:19545:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788748605.537993:0:19545:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788748605.537994:0:19545:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788748605.538037:0:19545:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788748605.538051:0:19545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377109376:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788748605.538093:0:19545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748605.538118:0:19545:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceece1be40 going to sleep for 11 seconds 00000100:00100000:1.0:1788748605.538192:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377109376 00000100:00100000:1.0:1788748605.538198:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377109376 00000100:00100000:1.0:1788748605.538229:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788748605.538237:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd839850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+16:19545:x1875638377109376:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788748605.538267:0:18857:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788748605.538280:0:18857:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:0.0:1788748605.549285:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:1.0:1788748605.580667:0:18857:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788748605.580711:0:18857:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788748605.583899:0:18878:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788748605.583907:0:18878:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788748605.583928:0:18878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ced7b43600/0x5b377f42a7a7d7de lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748605.583954:0:18878:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ced7b42600/0x5b377f42a7a7d74b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d744 expref: 16 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748605.583962:0:18878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ced7b43600/0x5b377f42a7a7d7de lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748605.584028:0:18878:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ced7b42600/0x5b377f42a7a7d74b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7d744 expref: 16 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748605.584043:0:18878:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ced7b42600/0x5b377f42a7a7d74b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7d744 expref: 16 pid: 18856 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748605.584056:0:18878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5196d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18878:1875638377109504:0@lo:104: 00000100:00100000:3.0:1788748605.584121:0:18878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748605.584194:0:18878:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cef7349f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788748605.584749:0:18845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377109504 00000100:00100000:2.0:1788748605.584759:0:18845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377109504 00000100:00100000:2.0:1788748605.584810:0:18845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788748605.584830:0:18845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5194a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ddbae60-91f9-474f-9a47-689ab5e32951+3:18878:x1875638377109504:12345-0@lo:104: 00010000:00010000:2.0:1788748605.584845:0:18845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99ced13e4c00/0x5b377f42a7a7d744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7d74b expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748605.584913:0:18845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788748605.584919:0:18845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5194a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ddbae60-91f9-474f-9a47-689ab5e32951+3:18878:x1875638377109504:12345-0@lo:104: Request processed in 92us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748605.584926:0:18845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788748605.585054:0:18878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5196d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18878:1875638377109504:0@lo:104: 00010000:00010000:0.0:1788748605.585087:0:18878:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ced7b43600/0x5b377f42a7a7d7de lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748605.585229:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748605.585235:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99ced13e4c00/0x5b377f42a7a7d744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7d74b expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748605.585242:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4c00 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:2.0:1788748605.585246:0:18851:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99ced13e4c00/0x5b377f42a7a7d744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7d74b expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748605.585253:0:18851:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99ced13e4c00/0x5b377f42a7a7d744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7d74b expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748605.585259:0:18851:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99ced13e4c00/0x5b377f42a7a7d744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7d74b expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748605.585264:0:18851:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788748605.585302:0:18851:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99ced13e4c00/0x5b377f42a7a7d744 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d74b expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748605.585310:0:18851:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748605.585338:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99ced13e4c00/0x5b377f42a7a7d744 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d74b expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748605.585357:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99ced13e4c00/0x5b377f42a7a7d744 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d74b expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748605.585559:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7307100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ddbae60-91f9-474f-9a47-689ab5e32951:3308:1875638377109632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788748605.585603:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748605.585700:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377109632 00000100:00100000:1.0:1788748605.585705:0:18849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377109632 00010000:00010000:1.0:1788748605.585727:0:18849:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ced7b42600/0x5b377f42a7a7d74b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7d744 expref: 17 pid: 18856 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748605.585757:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788748605.585765:0:18849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ddbae60-91f9-474f-9a47-689ab5e32951+17:3308:x1875638377109632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788748605.585776:0:18849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748605.585780:0:18849:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ced7b42600/0x5b377f42a7a7d74b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7d744 expref: 17 pid: 18856 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748605.585790:0:18849:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ced7b42600/0x5b377f42a7a7d74b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7d744 expref: 17 pid: 18856 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748605.585817:0:18849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced7b42600/0x5b377f42a7a7d74b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7d744 expref: 17 pid: 18856 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748605.585831:0:18849:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ced7b43600/0x5b377f42a7a7d7de lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748605.585838:0:18849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced7b43600/0x5b377f42a7a7d7de lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788748605.585852:0:18849:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001945404s 00010000:00010000:1.0:1788748605.585857:0:18849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ced7b43600/0x5b377f42a7a7d7de lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748605.585864:0:18849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ced7b43600/0x5b377f42a7a7d7de lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748605.585871:0:18849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ced7b43600/0x5b377f42a7a7d7de lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748605.585877:0:18849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ced7b43600/0x5b377f42a7a7d7de lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748605.585882:0:18849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b43600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748605.585885:0:18849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ced7b43600/0x5b377f42a7a7d7de lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748605.585892:0:18849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ced7b43600/0x5b377f42a7a7d7de lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748605.585907:0:18849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ced7b43600/0x5b377f42a7a7d7de lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748605.585922:0:18849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748605.585967:0:18849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ddbae60-91f9-474f-9a47-689ab5e32951+16:3308:x1875638377109632:12345-0@lo:103:ldlm_bl.0 Request processed in 203us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748605.585974:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788748605.586002:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7307100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ddbae60-91f9-474f-9a47-689ab5e32951:3308:1875638377109632:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788748605.586055:0:18878:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ced7b43600/0x5b377f42a7a7d7de lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748605.586188:0:18878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ced7b43600/0x5b377f42a7a7d7de lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748605.586194:0:18878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced7b43600/0x5b377f42a7a7d7de lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748605.586259:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748605.586262:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748605.586263:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748605.593189:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd839850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+15:19545:x1875638377109376:12345-0@lo:253:mount.lustre.0 Request processed in 54944us (55086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748605.593204:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788748605.593341:0:19545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:19545:1875638377109376:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788748605.593356:0:19545:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788748605.593359:0:19545:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788748605.593377:0:19545:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788748605.593379:0:19545:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788748605.593380:0:19545:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788748605.593381:0:19545:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788748605.593383:0:19545:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788748605.593384:0:19545:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788748605.593387:0:19545:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788748605.593388:0:19545:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788748605.593416:0:19545:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788748605.593854:0:19545:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788748605.594334:0:19545:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788748605.594551:0:19545:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788748605.597030:0:19545:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788748605.597195:0:19545:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788748605.597536:0:19545:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788748605.598578:0:19545:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1788748605.644988:0:19545:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788748605.644996:0:19545:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788748605.645045:0:19545:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788748605.645147:0:19545:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788748605.645160:0:19545:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788748605.645181:0:19545:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00000040:00080000:1.0:1788748605.870314:0:18897:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788748605.870321:0:18897:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788748605.871256:0:18897:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:1.0:1788748605.871303:0:18897:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788748605.871325:0:18897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:0.0:1788748606.574457:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788748607.341117:0:18859:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788748607.341125:0:18859:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99cdc6438000 from 10 10000000:01000000:1.0:1788748607.341130:0:18859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788748607.341175:0:18859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8a00/0x5b377f42a7a7d7e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748607.341186:0:18859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8a00/0x5b377f42a7a7d7e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748607.341198:0:18859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8a00/0x5b377f42a7a7d7e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748607.341237:0:18859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377109760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788748607.341306:0:18859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748607.341369:0:18859:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cee5a7f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748607.341528:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377109760 00000100:00100000:2.0:1788748607.341536:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377109760 00000100:00100000:2.0:1788748607.341592:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788748607.341601:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecf9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+15:18859:x1875638377109760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788748607.341615:0:18854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748607.341631:0:18854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cef6bdf000/0x5b377f42a7a7d7ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d7e5 expref: -99 pid: 18854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748607.341652:0:18854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cef6bdf000/0x5b377f42a7a7d7ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d7e5 expref: 16 pid: 18854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748607.341663:0:18854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cef6bdf000/0x5b377f42a7a7d7ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d7e5 expref: 16 pid: 18854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748607.341671:0:18854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cef6bdf000, rc 0) 00000100:00100000:2.0:1788748607.341723:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecf9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+16:18859:x1875638377109760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748607.341729:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788748607.341822:0:18859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377109760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748607.341841:0:18859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8a00/0x5b377f42a7a7d7e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d7ec expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748607.341849:0:18859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8a00/0x5b377f42a7a7d7e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d7ec expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748607.341896:0:18859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5196680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377109888:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788748607.341927:0:18859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748607.341950:0:18859:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cef7349cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748607.342287:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377109888 00000100:00100000:1.0:1788748607.342293:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377109888 00000100:00100000:1.0:1788748607.342387:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788748607.342396:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecf9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+16:18859:x1875638377109888:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788748607.342411:0:18856:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788748607.342427:0:18856:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788748607.342431:0:18856:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1788748607.342518:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecf9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+16:18859:x1875638377109888:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748607.342526:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788748607.345272:0:18859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5196680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377109888:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788748607.345364:0:18859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788748607.345374:0:18859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8a00/0x5b377f42a7a7d7e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d7ec expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748607.345384:0:18859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8a00/0x5b377f42a7a7d7e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d7ec expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748607.597125:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748608.621309:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748609.646303:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748610.672288:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788748610.799637:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788748610.799643:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788748610.799646:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788748610.799649:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788748610.799796:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788748610.799814:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ddbae60-91f9-474f-9a47-689ab5e32951:3308:1875638377110016:0@lo:400:kworker.0 00000100:00100000:0.0:1788748610.799874:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748610.799967:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875638377110272:0@lo:400:kworker.0 00000100:00100000:0.0:1788748610.799995:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748610.800032:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788748610.800037:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377110144:0@lo:400:kworker.0 00000100:00100000:0.0:1788748610.800055:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748610.800079:0:18862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377110272 00000100:00100000:0.0:1788748610.800087:0:18862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377110272 00000100:00100000:0.0:1788748610.800126:0:18862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377110144 00000100:00100000:0.0:1788748610.800129:0:18862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377110144 00000100:00100000:0.0:1788748610.800145:0:18862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788748610.800151:0:18862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875638377110272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748610.800196:0:18862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875638377110272:12345-0@lo:400:kworker.0 Request processed in 44us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748610.800202:0:18862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788748610.800221:0:18862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788748610.800226:0:18862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377110144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748610.800254:0:18862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377110144:12345-0@lo:400:kworker.0 Request processed in 26us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748610.800259:0:18862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788748610.800294:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cef76aa680 x1875638377110144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748610.800307:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377110144:0@lo:400:kworker.0 00010000:00080000:0.0:1788748610.800317:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cef76a9880 x1875638377110272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748610.800324:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875638377110272:0@lo:400:kworker.0 00000100:00100000:0.0:1788748610.800629:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377110016 00000100:00100000:0.0:1788748610.800642:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377110016 00000100:00100000:0.0:1788748610.800673:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788748610.800680:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecf9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+16:3308:x1875638377110016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748610.800711:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecf9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+16:3308:x1875638377110016:12345-0@lo:400:kworker.0 Request processed in 32us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748610.800716:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788748610.800743:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ddbae60-91f9-474f-9a47-689ab5e32951:3308:1875638377110016:0@lo:400:kworker.0 00000100:00080000:0.0:1788748610.801702:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1788748611.040952:0:19916:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788748611.695838:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748612.718267:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748613.744753:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748614.769497:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788748615.092812:0:18897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788748615.789898:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788748615.920976:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788748615.920984:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788748615.920987:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788748615.920990:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788748615.921055:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ddbae60-91f9-474f-9a47-689ab5e32951:3308:1875638377110400:0@lo:400:kworker.0 00000100:00100000:1.0:1788748615.921123:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748615.921179:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748615.921186:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875638377110528:0@lo:400:kworker.0 00000100:00100000:1.0:1788748615.921216:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748615.921254:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875638377110656:0@lo:400:kworker.0 00000100:00100000:1.0:1788748615.921303:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748615.921342:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377110400 00000100:00100000:1.0:1788748615.921350:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377110400 00000100:00100000:1.0:1788748615.921390:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788748615.921398:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecf9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+16:3308:x1875638377110400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748615.921449:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecf9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+16:3308:x1875638377110400:12345-0@lo:400:kworker.0 Request processed in 51us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748615.921457:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788748615.921494:0:18862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377110528 00000100:00100000:1.0:1788748615.921497:0:18862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377110528 00000100:00100000:1.0:1788748615.921536:0:18862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377110656 00000100:00100000:1.0:1788748615.921540:0:18862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377110656 00000100:00100000:1.0:1788748615.921572:0:18862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788748615.921578:0:18862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875638377110528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748615.921613:0:18862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875638377110528:12345-0@lo:400:kworker.0 Request processed in 36us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748615.921619:0:18862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788748615.921632:0:18862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788748615.921638:0:18862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875638377110656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748615.921672:0:18862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875638377110656:12345-0@lo:400:kworker.0 Request processed in 35us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748615.921678:0:18862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788748615.921714:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cef730d500 x1875638377110528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748615.921728:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875638377110528:0@lo:400:kworker.0 00000100:00100000:1.0:1788748615.921741:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ddbae60-91f9-474f-9a47-689ab5e32951:3308:1875638377110400:0@lo:400:kworker.0 00010000:00080000:3.0:1788748615.921760:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cef730dc00 x1875638377110656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748615.921773:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875638377110656:0@lo:400:kworker.0 00000100:00080000:0.0:1788748615.922009:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788748616.813174:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788748617.326369:0:20265:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788748617.326374:0:20265:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788748617.326482:0:20265:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99cee516f800 00000020:01000004:3.0:1788748617.326497:0:20265:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788748617.326521:0:20265:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788748617.326556:0:20265:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff99cdc69b99c0) 00000020:00000080:3.0:1788748617.326572:0:20265:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788748617.340304:0:20265:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788748617.340604:0:20265:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788748617.341411:0:20265:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788748617.345309:0:20265:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788748617.345618:0:20265:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:2.0:1788748617.345995:0:20265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 521: rc = 0 00100000:10000000:2.0:1788748617.346766:0:20265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 521: rc = 0 00100000:10000000:2.0:1788748617.346908:0:20265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 521: rc = 0 00100000:10000000:2.0:1788748617.349154:0:20265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 658: rc = 0 00100000:10000000:2.0:1788748617.349522:0:20265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 658: rc = 0 00100000:10000000:2.0:1788748617.349786:0:20265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 658: rc = 0 00100000:10000000:2.0:1788748617.350063:0:20265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 658: rc = 0 00100000:10000000:2.0:1788748617.350301:0:20265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 658: rc = 0 00100000:10000000:2.0:1788748617.352102:0:20265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 658: rc = 0 00000020:00000080:2.0:1788748617.354125:0:20265:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788748617.354139:0:20265:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788748617.354149:0:20265:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5b377f42a7a7d7fa 00000020:01000004:2.0:1788748617.354159:0:20265:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788748617.354181:0:20265:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.104@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788748617.354185:0:20265:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788748617.354191:0:20265:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788748617.354212:0:20265:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788748617.354216:0:20265:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788748617.370346:0:20265:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788748617.370395:0:20265:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.104@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788748617.370400:0:20265:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788748617.370401:0:20265:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788748617.370403:0:20265:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788748617.370404:0:20265:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788748617.370405:0:20265:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788748617.370407:0:20265:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788748617.370408:0:20265:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788748617.370410:0:20265:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788748617.370411:0:20265:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788748617.370415:0:20265:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788748617.370417:0:20265:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788748617.370418:0:20265:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788748617.370419:0:20265:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788748617.370420:0:20265:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788748617.370421:0:20265:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788748617.370422:0:20265:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788748617.370423:0:20265:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788748617.370424:0:20265:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788748617.370425:0:20265:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788748617.370453:0:20265:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788748617.370474:0:20265:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5194e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377110784:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788748617.370559:0:20265:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748617.370630:0:20265:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec870c840 going to sleep for 11 seconds 00000100:00100000:2.0:1788748617.370914:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377110784 00000100:00100000:2.0:1788748617.370923:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377110784 00000100:00100000:2.0:1788748617.370986:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788748617.370995:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecf9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+16:20265:x1875638377110784:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788748617.371891:0:18857:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788748617.371897:0:18857:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788748617.371900:0:18857:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788748617.386312:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecf9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+16:20265:x1875638377110784:12345-0@lo:253:mount.lustre.0 Request processed in 15310us (15744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748617.386326:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788748617.386460:0:20265:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5194e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377110784:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788748617.386476:0:20265:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788748617.386480:0:20265:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788748617.386481:0:20265:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788748617.386483:0:20265:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788748617.386484:0:20265:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788748617.386485:0:20265:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788748617.386486:0:20265:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788748617.386487:0:20265:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788748617.386489:0:20265:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788748617.386490:0:20265:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788748617.386760:0:20265:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99cee516f800 from lustre-OST0001 10000000:01000000:1.0:1788748617.386794:0:20265:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788748617.386797:0:20265:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788748617.386806:0:20265:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99cefd4a3380 local copy 00010000:00010000:1.0:1788748617.386816:0:20265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e5400/0x5b377f42a7a7d66b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d672 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748617.387078:0:20265:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377110912:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788748617.387118:0:20265:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748617.387156:0:20265:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cef7349cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748617.387504:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377110912 00000100:00100000:0.0:1788748617.387521:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377110912 00000100:00100000:0.0:1788748617.387570:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788748617.387580:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecf9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+16:20265:x1875638377110912:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748617.387781:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecf9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+16:20265:x1875638377110912:12345-0@lo:501:mount.lustre.0 Request processed in 201us (660us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788748617.387790:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788748617.387817:0:20265:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377110912:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788748617.387835:0:20265:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788748617.387979:0:20265:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788748617.387999:0:20265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e5400/0x5b377f42a7a7d66b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d672 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.388010:0:20265:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ced13e5400/0x5b377f42a7a7d66b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d672 expref: -99 pid: 18844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748617.388068:0:20265:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99cee516f800 10000000:01000000:1.0:1788748617.388075:0:20265:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788748617.388080:0:20265:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788748617.388083:0:20265:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788748617.388088:0:20265:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788748617.388090:0:20265:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788748617.388114:0:20265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7d801 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.388122:0:20265:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7d801 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.388132:0:20265:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7d801 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748617.388146:0:20265:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377111040:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788748617.388175:0:20265:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748617.388206:0:20265:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cef7349cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748617.388401:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377111040 00000100:00100000:3.0:1788748617.388406:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377111040 00000100:00100000:3.0:1788748617.388457:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788748617.388466:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecf9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+16:20265:x1875638377111040:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788748617.388476:0:18857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748617.388489:0:18857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced7b42000/0x5b377f42a7a7d808 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d801 expref: -99 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.388521:0:18857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced7b42000/0x5b377f42a7a7d808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d801 expref: 17 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.388532:0:18857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced7b42000/0x5b377f42a7a7d808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d801 expref: 17 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.388540:0:18857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b42000, rc 0) 00000100:00100000:3.0:1788748617.388587:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecf9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+17:20265:x1875638377111040:12345-0@lo:101:mount.lustre.0 Request processed in 122us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748617.388593:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788748617.388685:0:20265:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377111040:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788748617.388699:0:20265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7d801 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d808 expref: -99 pid: 20265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.388710:0:20265:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7d801 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d808 expref: -99 pid: 20265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788748617.389401:0:20265:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1788748617.390268:0:20265:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788748617.390532:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788748617.390575:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788748617.390611:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788748617.390659:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788748617.390698:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788748617.390751:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788748617.390799:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788748617.390833:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788748617.390882:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1788748617.390937:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1788748617.390946:0:20265:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1788748617.391058:0:20265:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7305880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377111168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788748617.391112:0:20265:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748617.391146:0:20265:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed661f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788748617.391544:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377111168 00000100:00100000:1.0:1788748617.391552:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377111168 00000100:00100000:1.0:1788748617.391649:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788748617.391659:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecf9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+17:20265:x1875638377111168:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788748617.392240:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecf9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+17:20265:x1875638377111168:12345-0@lo:501:mount.lustre.0 Request processed in 581us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748617.392249:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788748617.394196:0:20265:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7305880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377111168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788748617.394259:0:20265:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7305880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377111296:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788748617.394333:0:20265:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748617.400731:0:20265:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed661f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788748617.403415:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377111296 00000100:00100000:3.0:1788748617.403430:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377111296 00000100:00100000:0.0:1788748617.404573:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788748617.404593:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecf9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+17:20265:x1875638377111296:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788748617.406373:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecf9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+17:20265:x1875638377111296:12345-0@lo:503:mount.lustre.0 Request processed in 1780us (12032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748617.406386:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788748617.406606:0:20265:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7305880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377111296:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788748617.412547:0:20265:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788748617.412639:0:20265:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377111424:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788748617.412728:0:20265:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748617.412761:0:20265:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced2a24c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788748617.414691:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377111424 00000100:00100000:1.0:1788748617.414705:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377111424 00000100:00100000:1.0:1788748617.414784:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788748617.414794:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecf9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+17:20265:x1875638377111424:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788748617.415246:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecf9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+17:20265:x1875638377111424:12345-0@lo:502:mount.lustre.0 Request processed in 452us (2516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748617.415255:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788748617.416120:0:20265:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377111424:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788748617.416389:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1788748617.416688:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1788748617.416729:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1788748617.416781:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1788748617.416820:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1788748617.416854:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1788748617.416899:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1788748617.417120:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1788748617.417197:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:0.0:1788748617.417239:0:20265:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377111552:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788748617.417303:0:20265:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748617.417335:0:20265:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced2a24c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788748617.418091:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377111552 00000100:00100000:1.0:1788748617.418101:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377111552 00000100:00100000:1.0:1788748617.418157:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788748617.418166:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecf9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+17:20265:x1875638377111552:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788748617.418394:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecf9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+17:20265:x1875638377111552:12345-0@lo:502:mount.lustre.0 Request processed in 228us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748617.418402:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788748617.421837:0:20265:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377111552:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788748617.422148:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1788748617.422165:0:20265:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1788748617.424401:0:20266:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788748617.424412:0:20266:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788748617.424418:0:20266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748617.424420:0:20266:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788748617.424429:0:20266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788748617.425341:0:20266:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff99cdc69bb380) 00000020:00000080:3.0:1788748617.425371:0:20266:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788748617.425383:0:20266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788748617.425450:0:20266:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cee516f800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788748617.425458:0:20266:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788748617.425468:0:20266:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5b377f42a7a7d816 00010000:00010000:3.0:1788748617.432750:0:20266:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1788748617.434347:0:20266:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934605 00080000:10000000:3.0:1788748617.438701:0:20266:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:1.0:1788748617.443498:0:20266:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788748617.443520:0:20266:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748617.443527:0:20266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748617.443530:0:20266:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788748617.443536:0:20266:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748617.443540:0:20266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748617.443542:0:20266:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788748617.443546:0:20266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788748617.443547:0:20266:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788748617.443550:0:20266:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748617.443552:0:20266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748617.443553:0:20266:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788748617.443556:0:20266:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748617.443558:0:20266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748617.443559:0:20266:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788748617.443563:0:20266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788748617.443619:0:20266:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748617.443621:0:20266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748617.443632:0:20266:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788748617.443635:0:20266:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:2.0:1788748617.443854:0:20265:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788748617.443884:0:20265:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788748617.443905:0:20265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7d801 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d808 expref: -99 pid: 20265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.443916:0:20265:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8c00/0x5b377f42a7a7d801 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d808 expref: -99 pid: 20265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748617.443925:0:20265:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99cee516f800 from 1 10000000:01000000:2.0:1788748617.443936:0:20265:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788748617.443973:0:20265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cef6bdee00/0x5b377f42a7a7d81d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.443990:0:20265:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99cef6bdee00/0x5b377f42a7a7d81d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.444001:0:20265:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99cef6bdee00/0x5b377f42a7a7d81d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748617.444057:0:20265:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7305880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377111680:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788748617.444129:0:20265:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748617.444159:0:20265:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed661d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788748617.447533:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377111680 00000100:00100000:2.0:1788748617.447546:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377111680 00000100:00100000:2.0:1788748617.447603:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788748617.447611:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecf9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+17:20265:x1875638377111680:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788748617.447627:0:18857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748617.447644:0:18857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cef6bde800/0x5b377f42a7a7d824 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d81d expref: -99 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.447670:0:18857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cef6bde800/0x5b377f42a7a7d824 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d81d expref: 18 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.447680:0:18857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cef6bde800/0x5b377f42a7a7d824 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d81d expref: 18 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.447689:0:18857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cef6bde800, rc 0) 00000100:00100000:2.0:1788748617.447753:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecf9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+18:20265:x1875638377111680:12345-0@lo:101:mount.lustre.0 Request processed in 143us (3624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748617.447759:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788748617.447817:0:20265:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7305880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377111680:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788748617.447835:0:20265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99cef6bdee00/0x5b377f42a7a7d81d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d824 expref: -99 pid: 20265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.447844:0:20265:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99cef6bdee00/0x5b377f42a7a7d81d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d824 expref: -99 pid: 20265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788748617.448350:0:20265:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:2.0:1788748617.448879:0:20265:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788748617.449112:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788748617.449150:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788748617.449203:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788748617.449234:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788748617.449269:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788748617.449308:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788748617.449360:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1788748617.449391:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1788748617.449446:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788748617.449454:0:20265:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:2.0:1788748617.449535:0:20265:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7305880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377111808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788748617.449593:0:20265:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748617.449634:0:20265:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed661d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788748617.449972:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377111808 00000100:00100000:1.0:1788748617.449979:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377111808 00000100:00100000:1.0:1788748617.450037:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788748617.450045:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecf9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+18:20265:x1875638377111808:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788748617.450224:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecf9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+18:20265:x1875638377111808:12345-0@lo:501:mount.lustre.0 Request processed in 180us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748617.450232:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788748617.452900:0:20265:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7305880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377111808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788748617.453097:0:20265:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7305880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377111936:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788748617.453170:0:20265:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748617.453208:0:20265:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed661d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788748617.453280:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377111936 00000100:00100000:3.0:1788748617.453287:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377111936 00000100:00100000:3.0:1788748617.453421:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788748617.453431:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecf9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+18:20265:x1875638377111936:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788748617.453638:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecf9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+18:20265:x1875638377111936:12345-0@lo:503:mount.lustre.0 Request processed in 209us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748617.453646:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788748617.453677:0:20265:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7305880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377111936:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788748617.454615:0:20265:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788748617.454679:0:20265:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377112064:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788748617.454721:0:20265:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748617.454752:0:20265:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced2a24e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788748617.455557:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377112064 00000100:00100000:2.0:1788748617.455565:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377112064 00000100:00100000:2.0:1788748617.455605:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788748617.455613:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecf9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+18:20265:x1875638377112064:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788748617.455786:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecf9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+18:20265:x1875638377112064:12345-0@lo:502:mount.lustre.0 Request processed in 174us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748617.455793:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788748617.455922:0:20265:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377112064:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788748617.457217:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788748617.457284:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1788748617.458164:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1788748617.458229:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1788748617.458261:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1788748617.458312:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1788748617.460309:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1788748617.464597:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:0.0:1788748617.464989:0:20265:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377112192:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788748617.465169:0:20265:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748617.465211:0:20265:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced2a24e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788748617.465690:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377112192 00000100:00100000:2.0:1788748617.465699:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377112192 00000100:00100000:2.0:1788748617.465753:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788748617.465764:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee53eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+18:20265:x1875638377112192:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788748617.465979:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee53eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+18:20265:x1875638377112192:12345-0@lo:502:mount.lustre.0 Request processed in 216us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748617.465987:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788748617.466351:0:20265:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377112192:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788748617.466735:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1788748617.466749:0:20265:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788748617.476747:0:20270:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748617.476760:0:20270:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748617.476762:0:20270:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788748617.476784:0:20270:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cee516f800 00000020:00000080:1.0:1788748617.476787:0:20270:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788748617.476795:0:20270:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748617.476798:0:20270:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748617.476799:0:20270:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788748617.476802:0:20270:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748617.476804:0:20270:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748617.476806:0:20270:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788748617.476809:0:20270:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cee516f800 00000020:00000080:1.0:1788748617.476811:0:20270:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788748617.476873:0:20270:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748617.476876:0:20270:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748617.476878:0:20270:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788748617.476881:0:20270:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748617.476883:0:20270:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748617.476885:0:20270:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788748617.476888:0:20270:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99cee516f800 00000020:00000080:1.0:1788748617.476890:0:20270:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788748617.478592:0:20270:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748617.478846:0:20270:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748617.478850:0:20270:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788748617.478857:0:20270:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:3.0:1788748617.480257:0:20265:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788748617.480293:0:20265:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788748617.480313:0:20265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99cef6bdee00/0x5b377f42a7a7d81d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d824 expref: -99 pid: 20265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.480325:0:20265:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99cef6bdee00/0x5b377f42a7a7d81d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d824 expref: -99 pid: 20265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748617.480381:0:20265:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788748617.480384:0:20265:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99cee516f800 10000000:01000000:3.0:1788748617.480387:0:20265:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99cee516f800 10000000:01000000:3.0:1788748617.480390:0:20265:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788748617.480397:0:20265:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99cee516f800 from 1 10000000:01000000:3.0:1788748617.480399:0:20265:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788748617.480432:0:20265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced7b43a00/0x5b377f42a7a7d82b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.480441:0:20265:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ced7b43a00/0x5b377f42a7a7d82b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.480462:0:20265:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ced7b43a00/0x5b377f42a7a7d82b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748617.480499:0:20265:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5196a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377112320:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788748617.480602:0:20265:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748617.480651:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377112320 00000100:00100000:3.0:1788748617.480658:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377112320 00000100:00100000:3.0:1788748617.480695:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788748617.480703:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee53e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+18:20265:x1875638377112320:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788748617.480728:0:18854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748617.480740:0:18854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced7b42400/0x5b377f42a7a7d832 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d82b expref: -99 pid: 18854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.480914:0:18854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced7b42400/0x5b377f42a7a7d832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d82b expref: 19 pid: 18854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.480929:0:18854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced7b42400/0x5b377f42a7a7d832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d82b expref: 19 pid: 18854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.480938:0:18854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced7b42400, rc 0) 00000100:00100000:3.0:1788748617.480974:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee53e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+19:20265:x1875638377112320:12345-0@lo:101:mount.lustre.0 Request processed in 271us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748617.480981:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788748617.481266:0:20265:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec48c2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788748617.481288:0:20265:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5196a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377112320:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788748617.481303:0:20265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ced7b43a00/0x5b377f42a7a7d82b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d832 expref: -99 pid: 20265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.481312:0:20265:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ced7b43a00/0x5b377f42a7a7d82b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d832 expref: -99 pid: 20265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788748617.483390:0:20265:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:3.0:1788748617.484823:0:20265:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788748617.486483:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788748617.486579:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1788748617.486620:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1788748617.486714:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1788748617.486759:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1788748617.487236:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1788748617.487292:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1788748617.487333:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1788748617.487381:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788748617.487416:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1788748617.490729:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1788748617.491269:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1788748617.491524:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1788748617.491572:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1788748617.491623:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1788748617.491855:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1788748617.491894:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1788748617.492193:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1788748617.492252:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1788748617.492572:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1788748617.492646:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1788748617.493372:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1788748617.493419:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1788748617.493882:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1788748617.494010:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:3.0:1788748617.494397:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:3.0:1788748617.494443:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:3.0:1788748617.494556:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:3.0:1788748617.494587:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:3.0:1788748617.494641:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:3.0:1788748617.495210:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:3.0:1788748617.495246:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:3.0:1788748617.495277:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:3.0:1788748617.496617:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:3.0:1788748617.497390:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:3.0:1788748617.498408:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:3.0:1788748617.499405:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:3.0:1788748617.499873:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:3.0:1788748617.501572:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:3.0:1788748617.501988:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:3.0:1788748617.512383:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:3.0:1788748617.512414:0:20265:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:3.0:1788748617.512542:0:20265:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5196a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377112448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788748617.512607:0:20265:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748617.513866:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377112448 00000100:00100000:3.0:1788748617.513878:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377112448 00000100:00100000:3.0:1788748617.514348:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788748617.514361:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee53e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+19:20265:x1875638377112448:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788748617.514683:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee53e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+19:20265:x1875638377112448:12345-0@lo:501:mount.lustre.0 Request processed in 325us (2075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748617.514693:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788748617.514744:0:20265:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec48c2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788748617.516366:0:20265:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5196a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377112448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788748617.516434:0:20265:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5196a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377112576:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788748617.516503:0:20265:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748617.516553:0:20265:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced124c000 going to sleep for 11 seconds 00000100:00100000:0.0:1788748617.516618:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377112576 00000100:00100000:0.0:1788748617.516626:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377112576 00000100:00100000:0.0:1788748617.516746:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788748617.516758:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee53eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+19:20265:x1875638377112576:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788748617.518258:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee53eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+19:20265:x1875638377112576:12345-0@lo:503:mount.lustre.0 Request processed in 1497us (1750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748617.518270:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788748617.519455:0:20265:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5196a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377112576:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788748617.521584:0:20265:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788748617.521675:0:20265:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5196a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377112704:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788748617.521758:0:20265:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748617.521817:0:20265:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced124c000 going to sleep for 11 seconds 00000100:00100000:0.0:1788748617.522337:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377112704 00000100:00100000:0.0:1788748617.522346:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377112704 00000100:00100000:0.0:1788748617.522439:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788748617.522452:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee53e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+19:20265:x1875638377112704:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788748617.522747:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee53e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+19:20265:x1875638377112704:12345-0@lo:502:mount.lustre.0 Request processed in 298us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748617.522756:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788748617.522918:0:20265:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5196a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377112704:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788748617.523238:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788748617.523310:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1788748617.523362:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1788748617.523413:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1788748617.523450:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1788748617.523499:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1788748617.523544:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1788748617.523609:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1788748617.523659:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788748617.523695:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1788748617.523728:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1788748617.524011:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1788748617.524077:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1788748617.524169:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1788748617.524246:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1788748617.524301:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1788748617.524338:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1788748617.524408:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1788748617.524445:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1788748617.524477:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1788748617.524529:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1788748617.524576:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1788748617.524612:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1788748617.524683:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1788748617.524723:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:3.0:1788748617.524761:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:2.0:1788748617.527781:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:2.0:1788748617.527859:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:2.0:1788748617.527896:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:2.0:1788748617.527947:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:2.0:1788748617.527983:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:2.0:1788748617.528055:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:2.0:1788748617.528523:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:2.0:1788748617.528590:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:2.0:1788748617.528626:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:2.0:1788748617.528674:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:2.0:1788748617.528711:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:2.0:1788748617.528744:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:2.0:1788748617.528873:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:2.0:1788748617.528914:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:2.0:1788748617.528968:0:20265:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7306d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377112832:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788748617.529699:0:20265:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748617.529790:0:20265:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced2855000 going to sleep for 11 seconds 00000100:00100000:0.0:1788748617.529892:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377112832 00000100:00100000:0.0:1788748617.529900:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377112832 00000100:00100000:0.0:1788748617.530005:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788748617.530049:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee53eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+19:20265:x1875638377112832:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788748617.530575:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee53eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+19:20265:x1875638377112832:12345-0@lo:502:mount.lustre.0 Request processed in 561us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748617.530585:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788748617.530832:0:20265:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7306d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377112832:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788748617.531429:0:20265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:2.0:1788748617.531446:0:20265:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788748617.532784:0:20275:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788748617.532802:0:20275:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff99ceece73380) 00000020:00000080:0.0:1788748617.532824:0:20275:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1788748617.532907:0:20275:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cee516f800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788748617.532912:0:20275:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cee516f800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788748617.532923:0:20275:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cee516f800 3 00010000:00080000:0.0:1788748617.533101:0:20275:0:(ldlm_lib.c:103:import_set_conn()) imp ffff99ced3545800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.104@tcp at head 00010000:00010000:2.0:1788748617.536243:0:20275:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1788748617.536580:0:20275:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788748617.536619:0:20275:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788748617.536630:0:20275:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5b377f42a7a7d840 00000100:00080000:2.0:1788748617.536641:0:20275:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788748617.536652:0:20275:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99ced3545800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1788748617.536686:0:20275:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cef7306d80 x1875638377112960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788748617.536750:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875638377112960:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788748617.536817:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788748617.536878:0:20275:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788748617.536907:0:18862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377112960 00000100:00100000:1.0:1788748617.536924:0:18862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377112960 00000100:00100000:1.0:1788748617.536968:0:18862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788748617.536976:0:18862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875638377112960:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788748617.537007:0:18862:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 534 last 0 00000020:00000080:1.0:1788748617.537059:0:18862:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5b377f42a7a7d847 00000004:00100000:1.0:1788748617.537074:0:18862:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788748617.537104:0:18862:0:(import.c:65:import_set_state_nolock()) ffff99cee516e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788748617.537166:0:18862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875638377112960:12345-0@lo:38:llog_process_th.0 Request processed in 188us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748617.537173:0:18862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788748617.537199:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788748617.537204:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788748617.537207:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788748617.537210:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:2.0:1788748617.537277:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cef7306d80 x1875638377112960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788748627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748617.537284:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788748617.537294:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377113088:0@lo:400:kworker.0 00000100:00100000:1.0:1788748617.537322:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748617.537350:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377113216:0@lo:400:kworker.0 00000100:00100000:2.0:1788748617.537354:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788748617.537364:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1788748617.537371:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00100000:1.0:1788748617.537377:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788748617.537378:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788748617.537382:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99ced3545800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788748617.537390:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875638377112960:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788748617.537424:0:18864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377113088 00000100:00100000:1.0:1788748617.537429:0:18864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377113088 00000100:00100000:1.0:1788748617.537463:0:18864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377113216 00000100:00100000:1.0:1788748617.537467:0:18864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377113216 00000100:00100000:1.0:1788748617.537496:0:18864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788748617.537503:0:18864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377113088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748617.537559:0:18864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875638377113088:12345-0@lo:400:kworker.0 Request processed in 57us (235us total) trans 0 rc 0/0 00000040:00080000:2.0:1788748617.537568:0:20275:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000100:00100000:1.0:1788748617.537574:0:18864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788748617.537593:0:18864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788748617.537601:0:18864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377113216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748617.537639:0:18864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377113216:12345-0@lo:400:kworker.0 Request processed in 40us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748617.537645:0:18864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788748617.537671:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:2.0:1788748617.537687:0:20265:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 00010000:00080000:1.0:1788748617.537693:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cef730d500 x1875638377113088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748617.537706:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875638377113088:0@lo:400:kworker.0 00010000:00080000:1.0:1788748617.537731:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cef730ca80 x1875638377113216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748617.537738:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377113216:0@lo:400:kworker.0 10000000:01000000:2.0:1788748617.537788:0:20265:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788748617.537842:0:20265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced7b43a00/0x5b377f42a7a7d82b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d832 expref: -99 pid: 20265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.537852:0:20265:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ced7b43a00/0x5b377f42a7a7d82b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d832 expref: -99 pid: 20265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788748617.537896:0:20265:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788748617.537898:0:20265:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788748617.537900:0:20265:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788748617.537901:0:20265:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788748617.537902:0:20265:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788748617.537903:0:20265:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788748617.537904:0:20265:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788748617.537907:0:20265:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788748617.537908:0:20265:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788748617.537911:0:20265:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788748617.537914:0:20265:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788748617.537915:0:20265:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788748617.537916:0:20265:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788748617.537917:0:20265:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788748617.537922:0:20265:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788748617.537923:0:20265:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788748617.537924:0:20265:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788748617.537925:0:20265:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788748617.537926:0:20265:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788748617.537941:0:20265:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788748617.537962:0:20265:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7306d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377113344:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788748617.538006:0:20265:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748617.538048:0:20265:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced2855a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788748617.540590:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377113344 00000100:00100000:1.0:1788748617.540602:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377113344 00000100:00100000:1.0:1788748617.540661:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788748617.540673:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee53eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+19:20265:x1875638377113344:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788748617.540706:0:18854:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788748617.540722:0:18854:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788748617.562516:0:18854:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788748617.562535:0:18854:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788748617.562564:0:18878:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788748617.562569:0:18878:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788748617.562589:0:18878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ceed6f8200/0x5b377f42a7a7d84e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.562608:0:18878:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cef6bdf000/0x5b377f42a7a7d7ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d7e5 expref: 19 pid: 18854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.562636:0:18878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ceed6f8200/0x5b377f42a7a7d84e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.562676:0:18878:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cef6bdf000/0x5b377f42a7a7d7ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7d7e5 expref: 19 pid: 18854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.562691:0:18878:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cef6bdf000/0x5b377f42a7a7d7ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7d7e5 expref: 19 pid: 18854 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748617.562706:0:18878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18878:1875638377113472:0@lo:104: 00000100:00100000:1.0:1788748617.562839:0:18878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748617.562883:0:18878:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cedeb15240 going to sleep for 11 seconds 00000100:00100000:2.0:1788748617.563424:0:18845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377113472 00000100:00100000:2.0:1788748617.563432:0:18845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377113472 00000100:00100000:2.0:1788748617.563553:0:18845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788748617.563563:0:18845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ddbae60-91f9-474f-9a47-689ab5e32951+3:18878:x1875638377113472:12345-0@lo:104: 00010000:00010000:2.0:1788748617.563577:0:18845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8a00/0x5b377f42a7a7d7e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7d7ec expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.563635:0:18845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788748617.563641:0:18845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ddbae60-91f9-474f-9a47-689ab5e32951+3:18878:x1875638377113472:12345-0@lo:104: Request processed in 80us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748617.563647:0:18845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788748617.563712:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748617.563720:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8a00/0x5b377f42a7a7d7e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7d7ec expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.563729:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8a00 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:0.0:1788748617.563733:0:18851:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8a00/0x5b377f42a7a7d7e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7d7ec expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.563741:0:18851:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8a00/0x5b377f42a7a7d7e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7d7ec expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788748617.563749:0:18851:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8a00/0x5b377f42a7a7d7e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7d7ec expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748617.563755:0:18851:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788748617.563792:0:18851:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8a00/0x5b377f42a7a7d7e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d7ec expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.563808:0:18851:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788748617.563829:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8a00/0x5b377f42a7a7d7e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d7ec expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.563835:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99ceed6f8a00/0x5b377f42a7a7d7e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d7ec expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.563851:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748617.563853:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748617.563854:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748617.563967:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ddbae60-91f9-474f-9a47-689ab5e32951:3309:1875638377113600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748617.564011:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748617.564087:0:18878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18878:1875638377113472:0@lo:104: 00010000:00010000:0.0:1788748617.564108:0:18878:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ceed6f8200/0x5b377f42a7a7d84e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748617.564580:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377113600 00000100:00100000:3.0:1788748617.564587:0:18849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377113600 00010000:00010000:3.0:1788748617.564610:0:18849:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cef6bdf000/0x5b377f42a7a7d7ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7d7e5 expref: 20 pid: 18854 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748617.564640:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788748617.564647:0:18849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ddbae60-91f9-474f-9a47-689ab5e32951+20:3309:x1875638377113600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788748617.564658:0:18849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748617.564662:0:18849:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cef6bdf000/0x5b377f42a7a7d7ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7d7e5 expref: 20 pid: 18854 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.564672:0:18849:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cef6bdf000/0x5b377f42a7a7d7ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7d7e5 expref: 20 pid: 18854 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.564686:0:18849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cef6bdf000/0x5b377f42a7a7d7ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7d7e5 expref: 20 pid: 18854 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.564699:0:18849:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ceed6f8200/0x5b377f42a7a7d84e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.564707:0:18849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ceed6f8200/0x5b377f42a7a7d84e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788748617.564721:0:18849:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002152844s 00010000:00010000:3.0:1788748617.564725:0:18849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ceed6f8200/0x5b377f42a7a7d84e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.564733:0:18849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ceed6f8200/0x5b377f42a7a7d84e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.564749:0:18849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ceed6f8200/0x5b377f42a7a7d84e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.564755:0:18849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ceed6f8200/0x5b377f42a7a7d84e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.564761:0:18849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8200 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748617.565388:0:18849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ceed6f8200/0x5b377f42a7a7d84e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.565397:0:18849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ceed6f8200/0x5b377f42a7a7d84e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.565419:0:18849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ceed6f8200/0x5b377f42a7a7d84e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.565431:0:18849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748617.565568:0:18849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ddbae60-91f9-474f-9a47-689ab5e32951+19:3309:x1875638377113600:12345-0@lo:103:ldlm_bl.0 Request processed in 919us (1554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748617.565580:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788748617.565602:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ddbae60-91f9-474f-9a47-689ab5e32951:3309:1875638377113600:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788748617.565641:0:18878:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ceed6f8200/0x5b377f42a7a7d84e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.565650:0:18878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ceed6f8200/0x5b377f42a7a7d84e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.565657:0:18878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ceed6f8200/0x5b377f42a7a7d84e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748617.577190:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee53eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+18:20265:x1875638377113344:12345-0@lo:253:mount.lustre.0 Request processed in 36511us (39175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748617.577205:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788748617.577337:0:20265:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7306d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ddbae60-91f9-474f-9a47-689ab5e32951:20265:1875638377113344:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788748617.577352:0:20265:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788748617.577356:0:20265:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788748617.577358:0:20265:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788748617.577359:0:20265:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788748617.577361:0:20265:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788748617.577372:0:20265:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788748617.577374:0:20265:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788748617.577375:0:20265:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788748617.577377:0:20265:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788748617.577379:0:20265:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788748617.577394:0:20265:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788748617.577796:0:20265:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788748617.577951:0:20265:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788748617.578158:0:20265:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788748617.578315:0:20265:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788748617.578460:0:20265:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788748617.578645:0:20265:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788748617.585364:0:20265:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1788748617.642530:0:20265:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788748617.642538:0:20265:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788748617.642575:0:20265:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788748617.642629:0:20265:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788748617.642642:0:20265:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788748617.642669:0:20265:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788748617.840304:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748618.542587:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788748603/real 1788748603] req@ffff99cee5195500 x1875638377106432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748618 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748618.542617:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99cee5195500 x1875638377106432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748618 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748618.542637:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788748603/real 1788748603] req@ffff99cee5195c00 x1875638377106560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748618 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748618.542648:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99cee5195c00 x1875638377106560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748618 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788748618.542664:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99ceecee9800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788748618.542718:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788748618.542722:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377106432:0@lo:8:kworker.0 00000100:00080000:2.0:1788748618.542728:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99ced1419800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788748618.544128:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788748618.544136:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377106560:0@lo:8:kworker.0 00000100:00080000:1.0:1788748618.544259:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788748618.544263:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788748618.544267:0:8:0:(import.c:65:import_set_state_nolock()) ffff99ceecee9800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788748618.544272:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 520 00000100:00080000:1.0:1788748618.544277:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788748618.544291:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99ceecee9800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1788748618.544318:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cef730df80 x1875638377113856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788748618.544331:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788748618.544341:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788748618.544342:0:8:0:(import.c:65:import_set_state_nolock()) ffff99ced1419800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788748618.544346:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 520 00000100:00080000:1.0:1788748618.544349:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788748618.544354:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99ced1419800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1788748618.544490:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ddbae60-91f9-474f-9a47-689ab5e32951:3306:1875638377113728:0@lo:400:kworker.0 00000100:00100000:2.0:1788748618.544632:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748618.544693:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377113728 00000100:00100000:2.0:1788748618.544700:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377113728 00000100:00100000:2.0:1788748618.544740:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788748618.544748:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee53e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+18:3306:x1875638377113728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748618.544793:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee53e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+18:3306:x1875638377113728:12345-0@lo:400:kworker.0 Request processed in 45us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748618.544799:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788748618.544841:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ddbae60-91f9-474f-9a47-689ab5e32951:3306:1875638377113728:0@lo:400:kworker.0 00000100:00100000:2.0:1788748618.544857:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377113856:0@lo:8:kworker.0 00000100:00100000:2.0:1788748618.544884:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748618.544947:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cef730f480 x1875638377113984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788748618.545104:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377114112:0@lo:400:kworker.0 00000100:00100000:1.0:1788748618.545134:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748618.545163:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377114240:0@lo:400:kworker.0 00000100:00100000:1.0:1788748618.545191:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748618.545209:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748618.545214:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875638377114368:0@lo:400:kworker.0 00000100:00100000:1.0:1788748618.545238:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748618.545268:0:18863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377114112 00000100:00100000:1.0:1788748618.545272:0:18863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377114112 00000100:00100000:1.0:1788748618.545298:0:18863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377114240 00000100:00100000:1.0:1788748618.545301:0:18863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377114240 00000100:00100000:1.0:1788748618.545313:0:18863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377114368 00000100:00100000:1.0:1788748618.545316:0:18863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377114368 00000100:00100000:1.0:1788748618.545337:0:18863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788748618.545342:0:18863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377114112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748618.545606:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef730f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377113984:0@lo:8:kworker.0 00000100:00100000:2.0:1788748618.545633:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748618.545665:0:19548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377113856 00000100:00100000:3.0:1788748618.545670:0:19548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377113856 00000100:00100000:3.0:1788748618.545692:0:19548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377113984 00000100:00100000:3.0:1788748618.545695:0:19548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377113984 00000100:00100000:3.0:1788748618.545706:0:19548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788748618.545711:0:19548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1875638377113856:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788748618.545732:0:19548:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 535 last 0 00000020:00000080:3.0:1788748618.545757:0:19548:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b377f42a7a7d855 00002000:00100000:3.0:1788748618.545770:0:19548:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99cec6527800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788748618.545773:0:19548:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788748618.545776:0:19548:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788748618.545842:0:18863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377114112:12345-0@lo:400:kworker.0 Request processed in 499us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748618.545849:0:18863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788748618.545863:0:18863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788748618.545868:0:18863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377114240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748618.545905:0:18863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377114240:12345-0@lo:400:kworker.0 Request processed in 36us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748618.545910:0:18863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788748618.545921:0:18863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788748618.545927:0:18863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875638377114368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748618.545953:0:18863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875638377114368:12345-0@lo:400:kworker.0 Request processed in 26us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748618.545958:0:18863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1788748618.546109:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:3.0:1788748618.546119:0:19548:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00010000:00080000:1.0:1788748618.546130:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef730ca80 x1875638377114112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788748618.546139:0:19548:0:(import.c:65:import_set_state_nolock()) ffff99cec6526800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788748618.546141:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377114112:0@lo:400:kworker.0 00010000:00080000:1.0:1788748618.546164:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef730dc00 x1875638377114368/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748618.546173:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875638377114368:0@lo:400:kworker.0 00010000:00080000:1.0:1788748618.546182:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef730e680 x1875638377114240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748618.546188:0:19548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875638377113856:12345-0@lo:8:kworker.0 Request processed in 476us (1303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748618.546190:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377114240:0@lo:400:kworker.0 00000100:00100000:3.0:1788748618.546194:0:19548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788748618.546207:0:19548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788748618.546211:0:19548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1875638377113984:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788748618.546226:0:19548:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 535 last 0 00000020:00000080:3.0:1788748618.546250:0:19548:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b377f42a7a7d85c 00002000:00100000:3.0:1788748618.546257:0:19548:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99cec6524000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788748618.546260:0:19548:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788748618.546262:0:19548:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788748618.546459:0:19548:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788748618.546473:0:19548:0:(import.c:65:import_set_state_nolock()) ffff99cec6521000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788748618.546513:0:19548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875638377113984:12345-0@lo:8:kworker.0 Request processed in 300us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748618.546519:0:19548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788748618.550434:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef730f480 x1875638377113984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788748638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748618.550451:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788748618.550459:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788748618.550468:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788748618.550474:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788748618.550478:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99ced1419800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788748618.550510:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788748618.550516:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377113984:0@lo:8:kworker.0 00010000:00080000:2.0:1788748618.550532:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef730df80 x1875638377113856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788748638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748618.550540:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788748618.550545:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788748618.550549:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788748618.550552:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788748618.550554:0:3305:0:(import.c:65:import_set_state_nolock()) ffff99ceecee9800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788748618.550563:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788748618.550567:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef730df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875638377113856:0@lo:8:kworker.0 00000004:00080000:1.0:1788748618.551686:0:18886:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788748618.552002:0:18886:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 535594986947ns, next at 0ns, rc = 0 00000004:00080000:0.0:1788748618.553637:0:18887:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x22:0x0] 00000100:00100000:0.0:1788748618.553665:0:18887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76ab100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18887:1875638377114624:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788748618.553732:0:18887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748618.553758:0:18887:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced1367300 going to sleep for 11 seconds 00000004:00080000:3.0:1788748618.554441:0:18885:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1788748618.554457:0:18885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5195c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18885:1875638377114880:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788748618.554490:0:18885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748618.554525:0:18885:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced355e9c0 going to sleep for 11 seconds 00000004:00080000:3.0:1788748618.554539:0:18884:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788748618.554798:0:18884:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 535597782123ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788748618.555108:0:19547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377114624 00000100:00100000:0.0:1788748618.555116:0:19547:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377114624 00000100:00100000:0.0:1788748618.555256:0:19547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377114880 00000100:00100000:0.0:1788748618.555260:0:19547:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377114880 00000100:00100000:0.0:1788748618.555283:0:19547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788748618.555291:0:19547:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:18887:x1875638377114624:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788748618.559320:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377114496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788748618.559456:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748618.559810:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788748618.559821:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377114752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788748618.559848:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1788748618.560166:0:19547:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788748618.560175:0:19547:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1788748618.560181:0:19547:0:(ofd_dev.c:1493:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:35 to 0x280000400:65) 00000100:00100000:3.0:1788748618.560412:0:19550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377114496 00000100:00100000:3.0:1788748618.560421:0:19550:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377114496 00000100:00100000:3.0:1788748618.560451:0:19550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377114752 00000100:00100000:3.0:1788748618.560453:0:19550:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377114752 00000100:00100000:3.0:1788748618.560475:0:19550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788748618.560482:0:19550:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875638377114496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788748618.560515:0:19550:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788748618.560569:0:19550:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875638377114496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748618.560576:0:19550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788748618.560592:0:19550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788748618.560598:0:19550:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875638377114752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788748618.560619:0:19550:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788748618.560646:0:19550:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875638377114752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748618.560651:0:19550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788748618.560767:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788748618.560772:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788748618.561283:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cee5196300 x1875638377114752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748634 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748618.561310:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377114752:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788748618.561325:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef76aa680 x1875638377114496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748634 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748618.561337:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377114496:0@lo:13:osp-pre-1-0.0 00002000:00010000:0.0:1788748618.575592:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788748618.575604:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000277f1cf5/0x5b377f42a7a7d863 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.575620:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788748618.575625:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748618.575631:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000277f1cf5/0x5b377f42a7a7d863 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.575648:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000277f1cf5/0x5b377f42a7a7d863 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.575658:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000277f1cf5/0x5b377f42a7a7d863 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.575666:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000277f1cf5/0x5b377f42a7a7d863 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.575685:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748618.575698:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748618.575703:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000277f1cf5/0x5b377f42a7a7d863 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.575711:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4c00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.575715:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000277f1cf5/0x5b377f42a7a7d863 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.575735:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000277f1cf5/0x5b377f42a7a7d863 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.575750:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000277f1cf5/0x5b377f42a7a7d863 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.575757:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000277f1cf5/0x5b377f42a7a7d863 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.575771:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.575773:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.575775:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748618.576703:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788748618.576711:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d86a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.576722:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788748618.576725:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748618.576730:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d86a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.576740:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d86a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.576749:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d86a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.576762:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d86a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.576779:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748618.576789:0:18850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748618.576794:0:18850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d86a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.576801:0:18850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e5600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.576805:0:18850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d86a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.576813:0:18850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d86a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.576826:0:18850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d86a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.576834:0:18850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d86a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.576847:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.576849:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.576851:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748618.577403:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788748618.577416:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d871 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.577426:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788748618.577429:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748618.577434:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d871 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.577444:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d871 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.577452:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d871 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.577459:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d871 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.577474:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748618.577482:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748618.577487:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d871 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.577493:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4e00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.577497:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d871 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.577516:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d871 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.577533:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d871 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.577540:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d871 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.577555:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.577557:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.577559:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748618.578694:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788748618.578704:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d878 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.578719:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788748618.578723:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748618.578727:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d878 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.578737:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d878 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.578745:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d878 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.578753:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d878 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.578781:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748618.578793:0:18850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748618.578797:0:18850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d878 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.578803:0:18850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4800 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.578807:0:18850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d878 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.578815:0:18850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d878 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.578828:0:18850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d878 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.578834:0:18850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d878 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.578849:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.578851:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.578852:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748618.586159:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788748618.586171:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d81bd9a/0x5b377f42a7a7d87f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.586188:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788748618.586198:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748618.586204:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d81bd9a/0x5b377f42a7a7d87f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.586223:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d81bd9a/0x5b377f42a7a7d87f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.586233:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d81bd9a/0x5b377f42a7a7d87f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.586245:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d81bd9a/0x5b377f42a7a7d87f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.586261:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748618.586273:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748618.586278:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d81bd9a/0x5b377f42a7a7d87f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.586285:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.586290:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d81bd9a/0x5b377f42a7a7d87f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.586298:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d81bd9a/0x5b377f42a7a7d87f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.586312:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d81bd9a/0x5b377f42a7a7d87f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.586328:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d81bd9a/0x5b377f42a7a7d87f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.586350:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.586352:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.586353:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748618.586837:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788748618.586844:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0237719/0x5b377f42a7a7d886 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.586853:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788748618.586856:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748618.586861:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0237719/0x5b377f42a7a7d886 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.586870:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0237719/0x5b377f42a7a7d886 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.586878:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0237719/0x5b377f42a7a7d886 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.586884:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0237719/0x5b377f42a7a7d886 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.586899:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748618.586907:0:18850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748618.586916:0:18850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0237719/0x5b377f42a7a7d886 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.586923:0:18850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e5200 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.586926:0:18850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0237719/0x5b377f42a7a7d886 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.586934:0:18850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0237719/0x5b377f42a7a7d886 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.588010:0:18850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0237719/0x5b377f42a7a7d886 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.588036:0:18850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0237719/0x5b377f42a7a7d886 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.588054:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.588055:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.588057:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748618.588562:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788748618.588569:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000200859c/0x5b377f42a7a7d88d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.588580:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788748618.588584:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748618.588590:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000200859c/0x5b377f42a7a7d88d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.588613:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000200859c/0x5b377f42a7a7d88d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.588622:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000200859c/0x5b377f42a7a7d88d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.588629:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000200859c/0x5b377f42a7a7d88d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.588647:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748618.588656:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748618.588661:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000200859c/0x5b377f42a7a7d88d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.588667:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec0031400 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.588671:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000200859c/0x5b377f42a7a7d88d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.588678:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000200859c/0x5b377f42a7a7d88d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.588690:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000200859c/0x5b377f42a7a7d88d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.588697:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000200859c/0x5b377f42a7a7d88d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.588716:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.588718:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.588720:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748618.591830:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788748618.591844:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bfcda04/0x5b377f42a7a7d894 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.591861:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788748618.591866:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748618.591873:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bfcda04/0x5b377f42a7a7d894 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.591889:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bfcda04/0x5b377f42a7a7d894 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.593680:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bfcda04/0x5b377f42a7a7d894 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.593692:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bfcda04/0x5b377f42a7a7d894 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.593709:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748618.593723:0:18850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748618.593728:0:18850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bfcda04/0x5b377f42a7a7d894 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.593746:0:18850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec0031600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.593751:0:18850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bfcda04/0x5b377f42a7a7d894 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.593759:0:18850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bfcda04/0x5b377f42a7a7d894 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.593777:0:18850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bfcda04/0x5b377f42a7a7d894 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.593785:0:18850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bfcda04/0x5b377f42a7a7d894 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.593803:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.593805:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.593807:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748618.595280:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788748618.595291:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a50311d/0x5b377f42a7a7d89b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.595306:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788748618.595310:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748618.595316:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a50311d/0x5b377f42a7a7d89b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.595330:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a50311d/0x5b377f42a7a7d89b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.595344:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a50311d/0x5b377f42a7a7d89b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.595352:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a50311d/0x5b377f42a7a7d89b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.595368:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748618.595378:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748618.595383:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a50311d/0x5b377f42a7a7d89b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.595390:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec0030600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.595394:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a50311d/0x5b377f42a7a7d89b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.595403:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a50311d/0x5b377f42a7a7d89b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.595417:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a50311d/0x5b377f42a7a7d89b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.595424:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a50311d/0x5b377f42a7a7d89b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.595442:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.595448:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.595450:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748618.598551:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788748618.598564:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5e41300/0x5b377f42a7a7d8a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.598595:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788748618.598599:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748618.598605:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5e41300/0x5b377f42a7a7d8a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.598621:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5e41300/0x5b377f42a7a7d8a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.598631:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5e41300/0x5b377f42a7a7d8a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.598639:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5e41300/0x5b377f42a7a7d8a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.598660:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748618.598673:0:18850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748618.598678:0:18850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5e41300/0x5b377f42a7a7d8a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.598685:0:18850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec0031a00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.598689:0:18850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5e41300/0x5b377f42a7a7d8a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.598709:0:18850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5e41300/0x5b377f42a7a7d8a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.598725:0:18850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5e41300/0x5b377f42a7a7d8a2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.598731:0:18850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5e41300/0x5b377f42a7a7d8a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.598750:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.598752:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.598753:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748618.604184:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788748618.604197:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030a99c07/0x5b377f42a7a7d8a9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.604215:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788748618.604219:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748618.604225:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030a99c07/0x5b377f42a7a7d8a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.604239:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030a99c07/0x5b377f42a7a7d8a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.604249:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030a99c07/0x5b377f42a7a7d8a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.604264:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030a99c07/0x5b377f42a7a7d8a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.604289:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748618.604306:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748618.604325:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030a99c07/0x5b377f42a7a7d8a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.604333:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec0031000 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.604338:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030a99c07/0x5b377f42a7a7d8a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.604347:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030a99c07/0x5b377f42a7a7d8a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.604363:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030a99c07/0x5b377f42a7a7d8a9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.605109:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030a99c07/0x5b377f42a7a7d8a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.605131:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.605133:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.605135:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748618.606817:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788748618.606835:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004794076a/0x5b377f42a7a7d8b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.606849:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788748618.606854:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748618.606860:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004794076a/0x5b377f42a7a7d8b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.606874:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004794076a/0x5b377f42a7a7d8b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.606884:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004794076a/0x5b377f42a7a7d8b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.606891:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004794076a/0x5b377f42a7a7d8b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.607079:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748618.607089:0:18850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748618.607094:0:18850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004794076a/0x5b377f42a7a7d8b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.607102:0:18850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec0031200 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.607107:0:18850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004794076a/0x5b377f42a7a7d8b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.607116:0:18850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004794076a/0x5b377f42a7a7d8b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.607139:0:18850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004794076a/0x5b377f42a7a7d8b0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.607147:0:18850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004794076a/0x5b377f42a7a7d8b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.607163:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.607165:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.607166:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748618.607700:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788748618.607706:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f609b96/0x5b377f42a7a7d8b7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.607717:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788748618.607720:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748618.607726:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f609b96/0x5b377f42a7a7d8b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.607737:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f609b96/0x5b377f42a7a7d8b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.607744:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f609b96/0x5b377f42a7a7d8b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.607751:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f609b96/0x5b377f42a7a7d8b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.607775:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748618.607787:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748618.607791:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f609b96/0x5b377f42a7a7d8b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.607797:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec0030a00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.607800:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f609b96/0x5b377f42a7a7d8b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.607807:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f609b96/0x5b377f42a7a7d8b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.607818:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f609b96/0x5b377f42a7a7d8b7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.607825:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f609b96/0x5b377f42a7a7d8b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.607838:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.607839:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.607841:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748618.608338:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788748618.608345:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d81bd9a/0x5b377f42a7a7d8be lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.608353:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788748618.608361:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748618.608367:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d81bd9a/0x5b377f42a7a7d8be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788748618.609274:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788748618.610233:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d81bd9a/0x5b377f42a7a7d8be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.610246:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d81bd9a/0x5b377f42a7a7d8be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.610253:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d81bd9a/0x5b377f42a7a7d8be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.610270:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748618.610283:0:18850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748618.610288:0:18850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d81bd9a/0x5b377f42a7a7d8be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.610295:0:18850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.610300:0:18850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d81bd9a/0x5b377f42a7a7d8be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.610308:0:18850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d81bd9a/0x5b377f42a7a7d8be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.610322:0:18850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d81bd9a/0x5b377f42a7a7d8be lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.610339:0:18850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d81bd9a/0x5b377f42a7a7d8be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.610356:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.610359:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.610360:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748618.610892:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788748618.610899:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d8c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.610910:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788748618.610915:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748618.610920:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d8c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.610929:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d8c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.610936:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d8c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.610943:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d8c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.610955:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748618.610964:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748618.610975:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d8c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.610982:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4800 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.610986:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d8c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.610993:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d8c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.611005:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d8c5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.614921:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d8c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.614954:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.614956:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.614958:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748618.617188:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788748618.617200:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0237719/0x5b377f42a7a7d8cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.617215:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788748618.617219:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748618.617224:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0237719/0x5b377f42a7a7d8cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.617250:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0237719/0x5b377f42a7a7d8cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.617259:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0237719/0x5b377f42a7a7d8cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.617266:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0237719/0x5b377f42a7a7d8cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.617281:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748618.617293:0:18850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748618.617298:0:18850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0237719/0x5b377f42a7a7d8cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.617305:0:18850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e5200 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.617309:0:18850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0237719/0x5b377f42a7a7d8cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.617317:0:18850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0237719/0x5b377f42a7a7d8cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.617332:0:18850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0237719/0x5b377f42a7a7d8cc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.617338:0:18850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0237719/0x5b377f42a7a7d8cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.617359:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.617361:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.617364:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748618.617871:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788748618.617877:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d8d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.617886:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788748618.617890:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748618.617985:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d8d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.617999:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d8d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.618007:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d8d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.618036:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d8d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.618052:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748618.618061:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748618.618065:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d8d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.618083:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4e00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.618088:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d8d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.618097:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d8d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.618111:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d8d3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.618119:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d8d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.618141:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.618143:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.618146:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748618.618578:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788748618.618585:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d8da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.618593:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788748618.618597:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748618.618602:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d8da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.618612:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d8da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.618626:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d8da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.618634:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d8da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.618649:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748618.618659:0:18850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748618.618663:0:18850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d8da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.618669:0:18850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e5600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.618673:0:18850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d8da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.618680:0:18850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d8da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.618691:0:18850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d8da lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.618699:0:18850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d8da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.618713:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.618721:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.618723:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748618.626042:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788748618.626055:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d8e1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.626072:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788748618.626076:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748618.626081:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d8e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.626095:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d8e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.626105:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d8e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.626113:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d8e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.626131:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748618.626142:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748618.626148:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d8e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.626155:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4800 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.626160:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d8e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.626180:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d8e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.626196:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d8e1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.626205:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d8e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.626221:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.626222:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.626224:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748618.641616:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788748618.641628:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d8e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.641645:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788748618.641649:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748618.641656:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d8e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.641670:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d8e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.641679:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d8e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.641693:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d8e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.641719:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748618.641831:0:18850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748618.641839:0:18850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d8e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.641847:0:18850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4800 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748618.641851:0:18850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d8e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.641859:0:18850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d8e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.641878:0:18850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d8e8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.641886:0:18850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cdae3c7/0x5b377f42a7a7d8e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.641914:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748618.641916:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748618.641918:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748618.642230:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788748618.642235:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d8ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.642244:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788748618.642247:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748618.642251:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d8ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.642261:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d8ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.642269:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d8ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.642277:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d8ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.642299:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748618.642374:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748618.642386:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d8ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.642394:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e5600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748618.642398:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d8ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.642406:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d8ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.642418:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d8ef lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.642425:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000134594a5/0x5b377f42a7a7d8ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.642438:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748618.642440:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748618.642442:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748618.643878:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788748618.643888:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d8f6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.643910:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788748618.643913:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748618.643919:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d8f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.643931:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d8f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.643940:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d8f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.643948:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d8f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.643965:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748618.644667:0:18850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748618.644674:0:18850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d8f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.644684:0:18850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4e00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.644689:0:18850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d8f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.644699:0:18850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d8f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.644726:0:18850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d8f6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.644735:0:18850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d47908ec/0x5b377f42a7a7d8f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.644752:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.644754:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.644755:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748618.653554:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788748618.653566:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0237719/0x5b377f42a7a7d8fd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.653592:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788748618.653596:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748618.653602:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0237719/0x5b377f42a7a7d8fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.653617:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0237719/0x5b377f42a7a7d8fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.653627:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0237719/0x5b377f42a7a7d8fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.653634:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0237719/0x5b377f42a7a7d8fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.653665:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748618.653678:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748618.653683:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0237719/0x5b377f42a7a7d8fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.653691:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e5200 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.653696:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0237719/0x5b377f42a7a7d8fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.653706:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0237719/0x5b377f42a7a7d8fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.653723:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0237719/0x5b377f42a7a7d8fd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.653731:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0237719/0x5b377f42a7a7d8fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.653747:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.653749:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.653751:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748618.656116:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788748618.656126:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d81bd9a/0x5b377f42a7a7d904 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.656143:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788748618.656151:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748618.656157:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d81bd9a/0x5b377f42a7a7d904 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.656173:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d81bd9a/0x5b377f42a7a7d904 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.656182:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d81bd9a/0x5b377f42a7a7d904 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.656190:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d81bd9a/0x5b377f42a7a7d904 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.656205:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748618.656217:0:18850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748618.656223:0:18850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d81bd9a/0x5b377f42a7a7d904 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.656230:0:18850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.656235:0:18850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d81bd9a/0x5b377f42a7a7d904 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.656243:0:18850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d81bd9a/0x5b377f42a7a7d904 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.656259:0:18850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d81bd9a/0x5b377f42a7a7d904 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.656276:0:18850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d81bd9a/0x5b377f42a7a7d904 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.656292:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.656294:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.656296:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788748618.663277:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788748618.663289:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009155d277/0x5b377f42a7a7d90b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.663311:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1788748618.663316:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748618.663322:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009155d277/0x5b377f42a7a7d90b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.663337:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009155d277/0x5b377f42a7a7d90b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.663348:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009155d277/0x5b377f42a7a7d90b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.663356:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009155d277/0x5b377f42a7a7d90b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.664593:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748618.664707:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748618.664715:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009155d277/0x5b377f42a7a7d90b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.664726:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8e00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.664730:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009155d277/0x5b377f42a7a7d90b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.664739:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009155d277/0x5b377f42a7a7d90b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.664757:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009155d277/0x5b377f42a7a7d90b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.664764:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009155d277/0x5b377f42a7a7d90b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.664779:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.664781:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.664782:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788748618.669743:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788748618.669755:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000687c29e2/0x5b377f42a7a7d912 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.669771:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1788748618.669776:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748618.669782:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000687c29e2/0x5b377f42a7a7d912 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.669796:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000687c29e2/0x5b377f42a7a7d912 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.669834:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000687c29e2/0x5b377f42a7a7d912 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.669841:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000687c29e2/0x5b377f42a7a7d912 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.669861:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788748618.669875:0:18850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748618.669881:0:18850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000687c29e2/0x5b377f42a7a7d912 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.669888:0:18850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748618.669892:0:18850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000687c29e2/0x5b377f42a7a7d912 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.669901:0:18850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000687c29e2/0x5b377f42a7a7d912 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.669917:0:18850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000687c29e2/0x5b377f42a7a7d912 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.669924:0:18850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000687c29e2/0x5b377f42a7a7d912 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.669941:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748618.669949:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748618.669951:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788748618.671550:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788748618.671561:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba13cc89/0x5b377f42a7a7d919 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.671575:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1788748618.671579:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748618.671585:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba13cc89/0x5b377f42a7a7d919 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.671598:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba13cc89/0x5b377f42a7a7d919 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.671607:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba13cc89/0x5b377f42a7a7d919 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748618.671937:0:18859:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788748618.671942:0:18859:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99cdc6438000 from 11 10000000:01000000:0.0:1788748618.671945:0:18859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788748618.672048:0:18859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e4e00/0x5b377f42a7a7d920 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.672058:0:18859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ced13e4e00/0x5b377f42a7a7d920 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.672069:0:18859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ced13e4e00/0x5b377f42a7a7d920 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748618.672094:0:18859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377115008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788748618.672153:0:18859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748618.672196:0:18859:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced2a246c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748618.672256:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377115008 00000100:00100000:0.0:1788748618.672263:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377115008 00000100:00100000:0.0:1788748618.672306:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788748618.672314:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+18:18859:x1875638377115008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788748618.672326:0:18854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748618.672338:0:18854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced13e4c00/0x5b377f42a7a7d927 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7d920 expref: -99 pid: 18854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.672358:0:18854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced13e4c00/0x5b377f42a7a7d927 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7d920 expref: 19 pid: 18854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.672380:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba13cc89/0x5b377f42a7a7d919 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.672397:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748618.672901:0:18854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced13e4c00/0x5b377f42a7a7d927 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d920 expref: 19 pid: 18854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.672914:0:18854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e4c00, rc 0) 00002000:00010000:1.0:1788748618.672938:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788748618.672945:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070076a5e/0x5b377f42a7a7d92e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.672956:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1788748618.672960:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748618.672966:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070076a5e/0x5b377f42a7a7d92e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.672984:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070076a5e/0x5b377f42a7a7d92e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.672993:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070076a5e/0x5b377f42a7a7d92e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.672999:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070076a5e/0x5b377f42a7a7d92e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748618.673064:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+19:18859:x1875638377115008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 749us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748618.673072:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788748618.673185:0:18859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377115008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788748618.673201:0:18859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ced13e4e00/0x5b377f42a7a7d920 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d927 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.673210:0:18859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ced13e4e00/0x5b377f42a7a7d920 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7d927 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748618.673263:0:18859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7307100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377115136:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788748618.673299:0:18859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748618.673322:0:18859:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cee5a7e540 going to sleep for 11 seconds 00000100:00100000:2.0:1788748618.673334:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377115136 00000100:00100000:2.0:1788748618.673338:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377115136 00000100:00100000:2.0:1788748618.673361:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788748618.673366:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+19:18859:x1875638377115136:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788748618.673380:0:18857:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788748618.673393:0:18857:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788748618.673395:0:18857:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1788748618.673460:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+19:18859:x1875638377115136:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 93us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748618.673466:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788748618.673489:0:18859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7307100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377115136:0@lo:256:ll_cfg_requeue.0 00010000:00010000:0.0:1788748618.673660:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788748618.673668:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba13cc89/0x5b377f42a7a7d919 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.673673:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748618.673682:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9e00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.673687:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba13cc89/0x5b377f42a7a7d919 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.673689:0:18850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748618.673895:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba13cc89/0x5b377f42a7a7d919 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.673917:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba13cc89/0x5b377f42a7a7d919 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.673925:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba13cc89/0x5b377f42a7a7d919 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.673945:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.673948:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.673950:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788748618.674043:0:18859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788748618.674051:0:18859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ced13e4e00/0x5b377f42a7a7d920 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d927 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.674059:0:18859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ced13e4e00/0x5b377f42a7a7d920 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7d927 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.674140:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748618.674143:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748618.674144:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748618.674163:0:18850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070076a5e/0x5b377f42a7a7d92e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.674173:0:18850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8800 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748618.674177:0:18850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070076a5e/0x5b377f42a7a7d92e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.674186:0:18850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070076a5e/0x5b377f42a7a7d92e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.674198:0:18850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070076a5e/0x5b377f42a7a7d92e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.674205:0:18850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070076a5e/0x5b377f42a7a7d92e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.674226:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748618.674228:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748618.674230:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788748618.674549:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788748618.674555:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011367eb8/0x5b377f42a7a7d935 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.674565:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1788748618.674568:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748618.674574:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011367eb8/0x5b377f42a7a7d935 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.674586:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011367eb8/0x5b377f42a7a7d935 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.674593:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011367eb8/0x5b377f42a7a7d935 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.674601:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011367eb8/0x5b377f42a7a7d935 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.674616:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788748618.675207:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788748618.675214:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d93c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.675237:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1788748618.675240:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748618.675246:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d93c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.675257:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d93c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.675265:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d93c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.675273:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d93c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.675289:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788748618.675351:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788748618.675358:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011367eb8/0x5b377f42a7a7d935 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.675368:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.675379:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011367eb8/0x5b377f42a7a7d935 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.675389:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011367eb8/0x5b377f42a7a7d935 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.675404:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011367eb8/0x5b377f42a7a7d935 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.675411:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011367eb8/0x5b377f42a7a7d935 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.675430:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748618.675434:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d93c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.675440:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8200 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.675443:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d93c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.675451:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d93c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.675461:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d93c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.675469:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7473b50/0x5b377f42a7a7d93c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.675491:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.675494:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.675496:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788748618.675801:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788748618.675808:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd66e21e/0x5b377f42a7a7d943 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.675816:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1788748618.675820:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748618.675824:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd66e21e/0x5b377f42a7a7d943 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.675835:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd66e21e/0x5b377f42a7a7d943 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.675857:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd66e21e/0x5b377f42a7a7d943 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.675863:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd66e21e/0x5b377f42a7a7d943 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.675878:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788748618.675888:0:18850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748618.675892:0:18850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd66e21e/0x5b377f42a7a7d943 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.675900:0:18850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8a00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748618.675904:0:18850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd66e21e/0x5b377f42a7a7d943 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.675912:0:18850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd66e21e/0x5b377f42a7a7d943 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.675923:0:18850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd66e21e/0x5b377f42a7a7d943 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.675930:0:18850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd66e21e/0x5b377f42a7a7d943 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.675944:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748618.675953:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748618.675955:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748618.676030:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788748618.684523:0:19547:0:(ofd_dev.c:1520:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:34 00000100:00100000:1.0:1788748618.684615:0:19547:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:18887:x1875638377114624:12345-0@lo:5:osp-pre-1-0.0 Request processed in 129320us (130878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748618.684629:0:19547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788748618.684661:0:19547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788748618.684671:0:19547:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:18885:x1875638377114880:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788748618.685286:0:18887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76ab100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18887:1875638377114624:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788748618.685300:0:18887:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x22:0x0] 00000100:00100000:0.0:1788748618.685340:0:18887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76ab100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18887:1875638377115264:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788748618.685570:0:18887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748618.685670:0:18887:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced2a246c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748618.685675:0:19549:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788748618.685682:0:19549:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788748618.687044:0:19549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377115264 00000100:00100000:2.0:1788748618.687055:0:19549:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377115264 00000100:00100000:2.0:1788748618.687160:0:20347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788748618.687179:0:20347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:18887:x1875638377115264:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788748618.687225:0:20347:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 66 00000004:00080000:0.0:1788748618.691715:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:1.0:1788748618.693701:0:19547:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788748618.693713:0:19547:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:1.0:1788748618.693718:0:19547:0:(ofd_dev.c:1493:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:65) 00000100:00100000:2.0:1788748618.696214:0:20347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:18887:x1875638377115264:12345-0@lo:5:osp-pre-1-0.0 Request processed in 9033us (10637us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788748618.696226:0:20347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788748618.696800:0:18887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76ab100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18887:1875638377115264:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788748618.696816:0:18887:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00002000:00010000:2.0:1788748618.707384:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788748618.707395:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d052625/0x5b377f42a7a7d94a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.707410:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1788748618.707414:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748618.707420:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d052625/0x5b377f42a7a7d94a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.707436:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d052625/0x5b377f42a7a7d94a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.707445:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d052625/0x5b377f42a7a7d94a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.707452:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d052625/0x5b377f42a7a7d94a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.707478:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788748618.707603:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748618.707611:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d052625/0x5b377f42a7a7d94a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.707622:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cef6bdea00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748618.707626:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d052625/0x5b377f42a7a7d94a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.707636:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d052625/0x5b377f42a7a7d94a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.707655:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d052625/0x5b377f42a7a7d94a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.707662:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d052625/0x5b377f42a7a7d94a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.707695:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748618.707698:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748618.707700:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788748618.707954:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788748618.707959:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025aceaf9/0x5b377f42a7a7d951 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.707977:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1788748618.707980:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748618.707984:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025aceaf9/0x5b377f42a7a7d951 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.707993:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025aceaf9/0x5b377f42a7a7d951 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.708001:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025aceaf9/0x5b377f42a7a7d951 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.708008:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025aceaf9/0x5b377f42a7a7d951 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.708044:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788748618.708112:0:18850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748618.708118:0:18850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025aceaf9/0x5b377f42a7a7d951 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.708127:0:18850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cef6bde200 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748618.708131:0:18850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025aceaf9/0x5b377f42a7a7d951 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.708216:0:18850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025aceaf9/0x5b377f42a7a7d951 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.708229:0:18850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025aceaf9/0x5b377f42a7a7d951 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.708237:0:18850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025aceaf9/0x5b377f42a7a7d951 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.708253:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748618.708254:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748618.708256:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788748618.708421:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788748618.708427:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4dd178/0x5b377f42a7a7d958 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.708435:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1788748618.708438:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748618.708442:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4dd178/0x5b377f42a7a7d958 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.708451:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4dd178/0x5b377f42a7a7d958 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.708469:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4dd178/0x5b377f42a7a7d958 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.708475:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4dd178/0x5b377f42a7a7d958 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.708488:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748618.708497:0:20345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748618.708520:0:20345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4dd178/0x5b377f42a7a7d958 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.708527:0:20345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cef6bdf400 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748618.708531:0:20345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4dd178/0x5b377f42a7a7d958 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.708538:0:20345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4dd178/0x5b377f42a7a7d958 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.708548:0:20345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4dd178/0x5b377f42a7a7d958 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.708554:0:20345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4dd178/0x5b377f42a7a7d958 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.708569:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748618.708576:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748618.708578:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788748618.708958:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788748618.708964:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092130853/0x5b377f42a7a7d95f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.708972:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1788748618.708975:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748618.708979:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092130853/0x5b377f42a7a7d95f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.708987:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092130853/0x5b377f42a7a7d95f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.708993:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092130853/0x5b377f42a7a7d95f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.708999:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092130853/0x5b377f42a7a7d95f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.709040:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788748618.709069:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748618.709077:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092130853/0x5b377f42a7a7d95f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.709098:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cef6bdfa00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748618.709102:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092130853/0x5b377f42a7a7d95f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.709111:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092130853/0x5b377f42a7a7d95f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.709123:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092130853/0x5b377f42a7a7d95f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.709130:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092130853/0x5b377f42a7a7d95f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.709159:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748618.709162:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748618.709164:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788748618.709410:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788748618.709415:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000020dd7c1/0x5b377f42a7a7d966 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.709423:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1788748618.709426:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748618.709430:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000020dd7c1/0x5b377f42a7a7d966 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.709446:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000020dd7c1/0x5b377f42a7a7d966 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.709453:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000020dd7c1/0x5b377f42a7a7d966 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.709460:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000020dd7c1/0x5b377f42a7a7d966 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.709479:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788748618.709873:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788748618.709879:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020762213/0x5b377f42a7a7d96d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.709887:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1788748618.709890:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748618.709894:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020762213/0x5b377f42a7a7d96d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.709903:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020762213/0x5b377f42a7a7d96d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.709911:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020762213/0x5b377f42a7a7d96d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.709930:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020762213/0x5b377f42a7a7d96d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.709946:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788748618.709956:0:20345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788748618.709961:0:20345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000020dd7c1/0x5b377f42a7a7d966 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.709968:0:20345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cef6bdf200 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748618.709972:0:20345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000020dd7c1/0x5b377f42a7a7d966 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.709980:0:20345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000020dd7c1/0x5b377f42a7a7d966 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.709992:0:20345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000020dd7c1/0x5b377f42a7a7d966 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.709999:0:20345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000020dd7c1/0x5b377f42a7a7d966 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.710038:0:20345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748618.710041:0:20345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020762213/0x5b377f42a7a7d96d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.710057:0:20345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cef6bdec00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748618.710060:0:20345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020762213/0x5b377f42a7a7d96d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.710067:0:20345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020762213/0x5b377f42a7a7d96d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.710077:0:20345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020762213/0x5b377f42a7a7d96d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.710084:0:20345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020762213/0x5b377f42a7a7d96d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.710097:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748618.710098:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748618.710100:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748618.710845:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788748618.711773:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788748618.711783:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000152f4114/0x5b377f42a7a7d974 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.711796:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1788748618.711799:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748618.711805:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000152f4114/0x5b377f42a7a7d974 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.711816:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000152f4114/0x5b377f42a7a7d974 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.711833:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000152f4114/0x5b377f42a7a7d974 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.711840:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000152f4114/0x5b377f42a7a7d974 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.711993:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788748618.712444:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788748618.712450:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057266739/0x5b377f42a7a7d97b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.712458:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1788748618.712461:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748618.712465:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057266739/0x5b377f42a7a7d97b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.712474:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057266739/0x5b377f42a7a7d97b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.712480:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057266739/0x5b377f42a7a7d97b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.712487:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057266739/0x5b377f42a7a7d97b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.712621:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788748618.712628:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000152f4114/0x5b377f42a7a7d974 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.712637:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cef6bdf800 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.712641:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000152f4114/0x5b377f42a7a7d974 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.712649:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000152f4114/0x5b377f42a7a7d974 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.712666:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000152f4114/0x5b377f42a7a7d974 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.712686:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000152f4114/0x5b377f42a7a7d974 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.712706:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748618.712709:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057266739/0x5b377f42a7a7d97b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.712715:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cef6bde000 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.712718:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057266739/0x5b377f42a7a7d97b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.712726:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057266739/0x5b377f42a7a7d97b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.712737:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057266739/0x5b377f42a7a7d97b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.712745:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.712746:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.712748:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748618.712819:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788748618.712824:0:19547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057266739/0x5b377f42a7a7d97b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788748618.713464:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788748618.713470:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f39ac1e/0x5b377f42a7a7d982 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.713479:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1788748618.713483:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748618.713487:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f39ac1e/0x5b377f42a7a7d982 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.713497:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f39ac1e/0x5b377f42a7a7d982 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.713516:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f39ac1e/0x5b377f42a7a7d982 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.713523:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f39ac1e/0x5b377f42a7a7d982 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.713619:0:20345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748618.713626:0:20345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f39ac1e/0x5b377f42a7a7d982 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.713633:0:20345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cef6bdfc00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748618.713637:0:20345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f39ac1e/0x5b377f42a7a7d982 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.713644:0:20345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f39ac1e/0x5b377f42a7a7d982 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.713656:0:20345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f39ac1e/0x5b377f42a7a7d982 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.713675:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748618.713676:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748618.713678:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748618.713745:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788748618.713749:0:19547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f39ac1e/0x5b377f42a7a7d982 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788748618.714334:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788748618.714340:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aae8f8a/0x5b377f42a7a7d989 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.714349:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1788748618.714353:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748618.714358:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aae8f8a/0x5b377f42a7a7d989 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.714369:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006aae8f8a/0x5b377f42a7a7d989 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.714377:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aae8f8a/0x5b377f42a7a7d989 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.714385:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006aae8f8a/0x5b377f42a7a7d989 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.714433:0:18850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748618.714439:0:18850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006aae8f8a/0x5b377f42a7a7d989 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.714446:0:18850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cef6bdfe00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.714456:0:18850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006aae8f8a/0x5b377f42a7a7d989 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.714464:0:18850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006aae8f8a/0x5b377f42a7a7d989 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.714476:0:18850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006aae8f8a/0x5b377f42a7a7d989 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.714484:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.714485:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.714487:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748618.714617:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788748618.714623:0:19547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006aae8f8a/0x5b377f42a7a7d989 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788748618.715044:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788748618.715049:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abd9835f/0x5b377f42a7a7d990 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.715068:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1788748618.715071:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748618.715075:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abd9835f/0x5b377f42a7a7d990 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.715083:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abd9835f/0x5b377f42a7a7d990 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.715092:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abd9835f/0x5b377f42a7a7d990 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.715099:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abd9835f/0x5b377f42a7a7d990 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.715114:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788748618.715496:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788748618.715512:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fe47ab9/0x5b377f42a7a7d997 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.715521:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1788748618.715524:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748618.715527:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fe47ab9/0x5b377f42a7a7d997 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.715536:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fe47ab9/0x5b377f42a7a7d997 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.715555:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fe47ab9/0x5b377f42a7a7d997 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.715561:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fe47ab9/0x5b377f42a7a7d997 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.715580:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788748618.715991:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788748618.715997:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3684118/0x5b377f42a7a7d99e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.716005:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1788748618.716008:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748618.716011:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3684118/0x5b377f42a7a7d99e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.716044:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3684118/0x5b377f42a7a7d99e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.716052:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3684118/0x5b377f42a7a7d99e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.716058:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3684118/0x5b377f42a7a7d99e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.716077:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788748618.716449:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788748618.716455:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea38da40/0x5b377f42a7a7d9a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.716464:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1788748618.716467:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748618.716471:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea38da40/0x5b377f42a7a7d9a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.716480:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea38da40/0x5b377f42a7a7d9a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.716488:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea38da40/0x5b377f42a7a7d9a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.716494:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea38da40/0x5b377f42a7a7d9a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.716515:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788748618.716910:0:20345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788748618.716917:0:20345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abd9835f/0x5b377f42a7a7d990 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.716925:0:20345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cef6bde400 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748618.716929:0:20345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abd9835f/0x5b377f42a7a7d990 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.716937:0:20345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abd9835f/0x5b377f42a7a7d990 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.716952:0:20345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abd9835f/0x5b377f42a7a7d990 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.716959:0:20345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abd9835f/0x5b377f42a7a7d990 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.716980:0:20345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788748618.716983:0:20345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fe47ab9/0x5b377f42a7a7d997 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.716989:0:20345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cef6bdf000 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748618.716998:0:20345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fe47ab9/0x5b377f42a7a7d997 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.717006:0:20345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fe47ab9/0x5b377f42a7a7d997 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.717036:0:20345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fe47ab9/0x5b377f42a7a7d997 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.717044:0:20345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fe47ab9/0x5b377f42a7a7d997 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.717057:0:20345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788748618.717060:0:20345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3684118/0x5b377f42a7a7d99e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.717067:0:20345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cef6bdf600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748618.717070:0:20345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3684118/0x5b377f42a7a7d99e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.717077:0:20345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3684118/0x5b377f42a7a7d99e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.717086:0:20345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3684118/0x5b377f42a7a7d99e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.717093:0:20345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3684118/0x5b377f42a7a7d99e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.717111:0:20345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748618.717114:0:20345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea38da40/0x5b377f42a7a7d9a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.717120:0:20345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc8feba00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748618.717123:0:20345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea38da40/0x5b377f42a7a7d9a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.717130:0:20345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea38da40/0x5b377f42a7a7d9a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.717139:0:20345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea38da40/0x5b377f42a7a7d9a5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.717146:0:20345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea38da40/0x5b377f42a7a7d9a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.717156:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748618.717157:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748618.717159:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748618.717254:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748618.718088:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788748618.719772:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748618.719783:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6ff46bc/0x5b377f42a7a7d9ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.719800:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1788748618.719814:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748618.719820:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6ff46bc/0x5b377f42a7a7d9ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.719833:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6ff46bc/0x5b377f42a7a7d9ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.719843:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6ff46bc/0x5b377f42a7a7d9ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.719849:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6ff46bc/0x5b377f42a7a7d9ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.719873:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788748618.720422:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748618.720428:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f599861b/0x5b377f42a7a7d9b3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.720437:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1788748618.720440:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748618.720443:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f599861b/0x5b377f42a7a7d9b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.720452:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f599861b/0x5b377f42a7a7d9b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.720459:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f599861b/0x5b377f42a7a7d9b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.720471:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f599861b/0x5b377f42a7a7d9b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.720488:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788748618.720858:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748618.720863:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000699bf6e6/0x5b377f42a7a7d9ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.720872:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1788748618.720874:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748618.720879:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000699bf6e6/0x5b377f42a7a7d9ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.720888:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000699bf6e6/0x5b377f42a7a7d9ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.721028:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788748618.721036:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6ff46bc/0x5b377f42a7a7d9ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.721043:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b42e00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.721046:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6ff46bc/0x5b377f42a7a7d9ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.721055:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6ff46bc/0x5b377f42a7a7d9ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.721072:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6ff46bc/0x5b377f42a7a7d9ac lrc: 1/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.721080:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6ff46bc/0x5b377f42a7a7d9ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.721103:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748618.721107:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f599861b/0x5b377f42a7a7d9b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.721113:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b43c00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.721117:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f599861b/0x5b377f42a7a7d9b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.721124:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f599861b/0x5b377f42a7a7d9b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.721134:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f599861b/0x5b377f42a7a7d9b3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.721140:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f599861b/0x5b377f42a7a7d9b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.721151:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.721153:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.721155:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748618.721214:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748618.721257:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000699bf6e6/0x5b377f42a7a7d9ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.721265:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000699bf6e6/0x5b377f42a7a7d9ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.721315:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788748618.721728:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748618.721735:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8dbd15c/0x5b377f42a7a7d9c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.721750:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1788748618.721754:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748618.721758:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8dbd15c/0x5b377f42a7a7d9c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.721768:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8dbd15c/0x5b377f42a7a7d9c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.721776:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8dbd15c/0x5b377f42a7a7d9c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.721783:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8dbd15c/0x5b377f42a7a7d9c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.722929:0:18850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788748618.722940:0:18850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000699bf6e6/0x5b377f42a7a7d9ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.722951:0:18850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b43800 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.722962:0:18850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000699bf6e6/0x5b377f42a7a7d9ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.722971:0:18850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000699bf6e6/0x5b377f42a7a7d9ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.722988:0:18850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000699bf6e6/0x5b377f42a7a7d9ba lrc: 1/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.722996:0:18850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000699bf6e6/0x5b377f42a7a7d9ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.723012:0:18850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748618.723028:0:18850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8dbd15c/0x5b377f42a7a7d9c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.723034:0:18850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b43600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.723038:0:18850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8dbd15c/0x5b377f42a7a7d9c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.723045:0:18850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8dbd15c/0x5b377f42a7a7d9c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.723055:0:18850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8dbd15c/0x5b377f42a7a7d9c1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.723061:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.723069:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.723072:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748618.725110:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788748618.725123:0:19547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8dbd15c/0x5b377f42a7a7d9c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.726376:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788748618.726830:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748618.726841:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f20aecfa/0x5b377f42a7a7d9c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.726856:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1788748618.726861:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748618.726867:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f20aecfa/0x5b377f42a7a7d9c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.726894:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f20aecfa/0x5b377f42a7a7d9c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.726905:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f20aecfa/0x5b377f42a7a7d9c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.726912:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f20aecfa/0x5b377f42a7a7d9c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.726934:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748618.726980:0:20345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748618.726987:0:20345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f20aecfa/0x5b377f42a7a7d9c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.726995:0:20345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b42600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748618.727005:0:20345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f20aecfa/0x5b377f42a7a7d9c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.727031:0:20345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f20aecfa/0x5b377f42a7a7d9c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.727048:0:20345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f20aecfa/0x5b377f42a7a7d9c8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.727056:0:20345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f20aecfa/0x5b377f42a7a7d9c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.727074:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748618.727076:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748618.727078:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788748618.727793:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748618.727801:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e92d515/0x5b377f42a7a7d9cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.727810:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1788748618.727813:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748618.727818:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e92d515/0x5b377f42a7a7d9cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.727828:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e92d515/0x5b377f42a7a7d9cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.727835:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e92d515/0x5b377f42a7a7d9cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.727852:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e92d515/0x5b377f42a7a7d9cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.727876:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788748618.727982:0:18850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748618.727989:0:18850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e92d515/0x5b377f42a7a7d9cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.727997:0:18850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b42a00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748618.728000:0:18850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e92d515/0x5b377f42a7a7d9cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.729056:0:18850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e92d515/0x5b377f42a7a7d9cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.729074:0:18850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e92d515/0x5b377f42a7a7d9cf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.729081:0:18850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e92d515/0x5b377f42a7a7d9cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.729098:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748618.729099:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748618.729101:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788748618.729657:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748618.729665:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005669b9cb/0x5b377f42a7a7d9d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.729676:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1788748618.729680:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748618.729685:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005669b9cb/0x5b377f42a7a7d9d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.729697:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005669b9cb/0x5b377f42a7a7d9d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.729705:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005669b9cb/0x5b377f42a7a7d9d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.729712:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005669b9cb/0x5b377f42a7a7d9d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.729729:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748618.730690:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748618.730698:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005669b9cb/0x5b377f42a7a7d9d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.730708:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b43e00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.730712:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005669b9cb/0x5b377f42a7a7d9d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.730721:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005669b9cb/0x5b377f42a7a7d9d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.730736:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005669b9cb/0x5b377f42a7a7d9d6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.730743:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005669b9cb/0x5b377f42a7a7d9d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.730759:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.730760:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.730762:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788748618.731289:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748618.731297:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005dd1f2ec/0x5b377f42a7a7d9dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.731313:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1788748618.731318:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748618.731323:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005dd1f2ec/0x5b377f42a7a7d9dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.731332:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005dd1f2ec/0x5b377f42a7a7d9dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.731340:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005dd1f2ec/0x5b377f42a7a7d9dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.731347:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005dd1f2ec/0x5b377f42a7a7d9dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.731368:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788748618.731795:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748618.731801:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010897775/0x5b377f42a7a7d9e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.731809:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1788748618.731812:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748618.731816:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010897775/0x5b377f42a7a7d9e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.731825:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010897775/0x5b377f42a7a7d9e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.731844:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010897775/0x5b377f42a7a7d9e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.731851:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010897775/0x5b377f42a7a7d9e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.731868:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788748618.732006:0:18850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788748618.732025:0:18850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005dd1f2ec/0x5b377f42a7a7d9dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.732034:0:18850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b43200 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748618.732038:0:18850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005dd1f2ec/0x5b377f42a7a7d9dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.732045:0:18850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005dd1f2ec/0x5b377f42a7a7d9dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.732059:0:18850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005dd1f2ec/0x5b377f42a7a7d9dd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.732078:0:18850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005dd1f2ec/0x5b377f42a7a7d9dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.732096:0:18850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748618.732099:0:18850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010897775/0x5b377f42a7a7d9e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.732105:0:18850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced7b42c00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748618.732108:0:18850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010897775/0x5b377f42a7a7d9e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.732116:0:18850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010897775/0x5b377f42a7a7d9e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.732126:0:18850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010897775/0x5b377f42a7a7d9e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.732126:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748618.732133:0:18850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010897775/0x5b377f42a7a7d9e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748618.732144:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748618.732146:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748618.732147:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788748618.733441:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748618.733450:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069fcb657/0x5b377f42a7a7d9eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.733461:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1788748618.733465:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748618.733470:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069fcb657/0x5b377f42a7a7d9eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.733481:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069fcb657/0x5b377f42a7a7d9eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.733490:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069fcb657/0x5b377f42a7a7d9eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.733497:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069fcb657/0x5b377f42a7a7d9eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.733576:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788748618.733948:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748618.733954:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7d9f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.733961:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1788748618.733964:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748618.733968:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7d9f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.733976:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7d9f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.733983:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7d9f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.733989:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7d9f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.740621:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788748618.740636:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069fcb657/0x5b377f42a7a7d9eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.740666:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2200 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.740672:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069fcb657/0x5b377f42a7a7d9eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.740683:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069fcb657/0x5b377f42a7a7d9eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.740703:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069fcb657/0x5b377f42a7a7d9eb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.740711:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069fcb657/0x5b377f42a7a7d9eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.740794:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748618.740801:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7d9f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.740808:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2e00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:2.0:1788748618.740811:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7d9f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.740818:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7d9f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.740829:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7d9f2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748618.740844:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748618.740846:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748618.740848:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748618.740934:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788748618.740943:0:19547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7d9f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.745635:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788748618.748202:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748618.748218:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7d9f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.748245:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1788748618.748250:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748618.748257:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7d9f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.748274:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7d9f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.748284:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7d9f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.748291:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7d9f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.748316:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788748618.748911:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748618.748917:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1580adf/0x5b377f42a7a7da00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.748927:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1788748618.748930:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748618.748934:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1580adf/0x5b377f42a7a7da00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.748944:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1580adf/0x5b377f42a7a7da00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.748964:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1580adf/0x5b377f42a7a7da00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.748971:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1580adf/0x5b377f42a7a7da00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.749072:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788748618.750141:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748618.750152:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007147dbc8/0x5b377f42a7a7da07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.750165:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1788748618.750168:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748618.750172:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007147dbc8/0x5b377f42a7a7da07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.750184:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007147dbc8/0x5b377f42a7a7da07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.750192:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007147dbc8/0x5b377f42a7a7da07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.750199:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007147dbc8/0x5b377f42a7a7da07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.753578:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788748618.753593:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7d9f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.753607:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2e00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.753612:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7d9f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.753624:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7d9f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.753684:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7d9f9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.753692:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000413d6fe3/0x5b377f42a7a7d9f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.753719:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788748618.753723:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1580adf/0x5b377f42a7a7da00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.753729:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2000 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.753733:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1580adf/0x5b377f42a7a7da00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.753740:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1580adf/0x5b377f42a7a7da00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.753749:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1580adf/0x5b377f42a7a7da00 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.753757:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1580adf/0x5b377f42a7a7da00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.753768:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748618.753772:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007147dbc8/0x5b377f42a7a7da07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.753786:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3c00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.753789:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007147dbc8/0x5b377f42a7a7da07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.753796:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007147dbc8/0x5b377f42a7a7da07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.753807:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007147dbc8/0x5b377f42a7a7da07 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.753814:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.753816:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.753818:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748618.754160:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788748618.754168:0:19547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007147dbc8/0x5b377f42a7a7da07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788748618.754783:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748618.754790:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029b797d7/0x5b377f42a7a7da0e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.754801:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1788748618.754805:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748618.754812:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029b797d7/0x5b377f42a7a7da0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.754823:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029b797d7/0x5b377f42a7a7da0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.754831:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029b797d7/0x5b377f42a7a7da0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.754837:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029b797d7/0x5b377f42a7a7da0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.754852:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788748618.755262:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748618.755268:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c282abd7/0x5b377f42a7a7da15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.755281:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1788748618.755284:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748618.755288:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c282abd7/0x5b377f42a7a7da15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.755298:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c282abd7/0x5b377f42a7a7da15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.755305:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c282abd7/0x5b377f42a7a7da15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.755311:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c282abd7/0x5b377f42a7a7da15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.755319:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788748618.755693:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748618.755699:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091eaa09a/0x5b377f42a7a7da1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.755706:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1788748618.755709:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748618.755713:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091eaa09a/0x5b377f42a7a7da1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.755721:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091eaa09a/0x5b377f42a7a7da1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.755738:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091eaa09a/0x5b377f42a7a7da1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.755744:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091eaa09a/0x5b377f42a7a7da1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.755752:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788748618.756194:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788748618.756201:0:19547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acea81c7/0x5b377f42a7a7da23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.756210:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1788748618.756213:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748618.756217:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acea81c7/0x5b377f42a7a7da23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.756226:0:19547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acea81c7/0x5b377f42a7a7da23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.756233:0:19547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acea81c7/0x5b377f42a7a7da23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.756240:0:19547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acea81c7/0x5b377f42a7a7da23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748618.756257:0:19547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00080000:3.0:1788748618.756812:0:19547:0:(ofd_dev.c:1520:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:3.0:1788748618.756905:0:19547:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:18885:x1875638377114880:12345-0@lo:5:osp-pre-0-0.0 Request processed in 72233us (202410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748618.756915:0:19547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788748618.756977:0:18885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5195c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18885:1875638377114880:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788748618.756991:0:18885:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x41:0x0] from OST, last_created [0x240000400:0x41:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1788748618.757064:0:18885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5195c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18885:1875638377115392:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788748618.757094:0:18885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748618.757134:0:18885:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced1367e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788748618.757152:0:19549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377115392 00000100:00100000:3.0:1788748618.757158:0:19549:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377115392 00000100:00100000:3.0:1788748618.757196:0:19549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788748618.757204:0:19549:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:18885:x1875638377115392:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788748618.757242:0:19549:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 66 00010000:00010000:0.0:1788748618.757653:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788748618.757662:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029b797d7/0x5b377f42a7a7da0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.757673:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.757677:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029b797d7/0x5b377f42a7a7da0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.757687:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029b797d7/0x5b377f42a7a7da0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.757705:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029b797d7/0x5b377f42a7a7da0e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.757720:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029b797d7/0x5b377f42a7a7da0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.757739:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788748618.757742:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c282abd7/0x5b377f42a7a7da15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.757748:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3200 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.757751:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c282abd7/0x5b377f42a7a7da15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.757758:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c282abd7/0x5b377f42a7a7da15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.757769:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c282abd7/0x5b377f42a7a7da15 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.757776:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c282abd7/0x5b377f42a7a7da15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.757786:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788748618.757789:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091eaa09a/0x5b377f42a7a7da1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.757795:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3800 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.757803:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091eaa09a/0x5b377f42a7a7da1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.757811:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091eaa09a/0x5b377f42a7a7da1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.757823:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091eaa09a/0x5b377f42a7a7da1c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.757831:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091eaa09a/0x5b377f42a7a7da1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.757843:0:18851:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748618.757846:0:18851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acea81c7/0x5b377f42a7a7da23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.757852:0:18851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748618.757855:0:18851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acea81c7/0x5b377f42a7a7da23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.757862:0:18851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acea81c7/0x5b377f42a7a7da23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.757872:0:18851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acea81c7/0x5b377f42a7a7da23 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.757879:0:18851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acea81c7/0x5b377f42a7a7da23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748618.757898:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.757900:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.757902:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748618.757909:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748618.758147:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748618.764424:0:19549:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:18885:x1875638377115392:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7215us (7323us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788748618.764440:0:19549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788748618.764577:0:18885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5195c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18885:1875638377115392:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788748618.764607:0:18885:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x41:0x0]-[0x240000400:0x61:0x0] 00010000:00010000:2.0:1788748618.861582:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748619.886987:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748620.909414:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788748621.179599:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:2.0:1788748621.179640:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788748621.933354:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748622.957246:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788748623.179481:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:1.0:1788748623.179494:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788748623.598396:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7307100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377115520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788748623.598462:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748623.599390:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377115648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748623.599431:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748623.600451:0:19550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377115520 00000100:00100000:3.0:1788748623.600462:0:19550:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377115520 00000100:00100000:3.0:1788748623.600524:0:19550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377115648 00000100:00100000:3.0:1788748623.600528:0:19550:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377115648 00000100:00100000:3.0:1788748623.600545:0:19550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788748623.600553:0:19550:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377115520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788748623.600589:0:19550:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788748623.600659:0:19550:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875638377115520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (2196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748623.600666:0:19550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788748623.600684:0:19550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788748623.600690:0:19550:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377115648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788748623.600708:0:19550:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788748623.600740:0:19550:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377115648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748623.600746:0:19550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788748623.600842:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788748623.600846:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788748623.600876:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788748623.600896:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7307100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875638377115520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788748623.600923:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788748623.600934:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377115648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748623.601592:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377115904:0@lo:400:kworker.0 00000100:00100000:0.0:1788748623.601633:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748623.601659:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788748623.601665:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ddbae60-91f9-474f-9a47-689ab5e32951:3307:1875638377115776:0@lo:400:kworker.0 00000100:00100000:0.0:1788748623.601692:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748623.601727:0:18863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377115904 00000100:00100000:0.0:1788748623.601731:0:18863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377115904 00000100:00100000:0.0:1788748623.601847:0:18863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788748623.601857:0:18863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377115904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748623.601901:0:18863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377115904:12345-0@lo:400:kworker.0 Request processed in 45us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748623.601907:0:18863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788748623.601928:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377115776 00000100:00100000:0.0:1788748623.601932:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377115776 00000100:00100000:0.0:1788748623.602119:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788748623.602126:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+19:3307:x1875638377115776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748623.602156:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+19:3307:x1875638377115776:12345-0@lo:400:kworker.0 Request processed in 32us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748623.602173:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788748623.602214:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ddbae60-91f9-474f-9a47-689ab5e32951:3307:1875638377115776:0@lo:400:kworker.0 00010000:00080000:0.0:1788748623.602227:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef76ab800 x1875638377115904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748623.602237:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377115904:0@lo:400:kworker.0 00000100:00100000:3.0:1788748623.602428:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377116032:0@lo:400:kworker.0 00000100:00100000:3.0:1788748623.602458:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748623.602490:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788748623.602496:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875638377116160:0@lo:400:kworker.0 00000100:00100000:3.0:1788748623.602514:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748623.602542:0:18862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377116032 00000100:00100000:3.0:1788748623.602546:0:18862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377116032 00000100:00100000:3.0:1788748623.602577:0:18862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377116160 00000100:00100000:3.0:1788748623.602580:0:18862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377116160 00000100:00100000:3.0:1788748623.602600:0:18862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788748623.602607:0:18862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377116032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748623.602652:0:18862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377116032:12345-0@lo:400:kworker.0 Request processed in 46us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748623.602659:0:18862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788748623.602672:0:18862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788748623.602678:0:18862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875638377116160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748623.602704:0:18862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875638377116160:12345-0@lo:400:kworker.0 Request processed in 27us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748623.602709:0:18862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788748623.602725:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788748623.602743:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef76ab480 x1875638377116160/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748623.602752:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875638377116160:0@lo:400:kworker.0 00010000:00080000:3.0:1788748623.603922:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cef76a9c00 x1875638377116032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748623.603954:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377116032:0@lo:400:kworker.0 00010000:00010000:1.0:1788748623.986152:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788748623.994823:0:20624:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788748625.008345:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788748625.331806:0:18897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788748625.989771:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748625.995140:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358247424 00000100:00100000:2.0:1788748625.995155:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358247424 00000100:00100000:2.0:1788748625.995322:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 75 00000100:00100000:2.0:1788748625.995330:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2346:x1875638358247424:12345-192.168.203.4@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788748625.995356:0:18854:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from 745dd5eb-2b80-4752-9076-ef21465f0c36@192.168.203.4@tcp t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:2.0:1788748625.995385:0:18854:0:(genops.c:1384:class_connect()) connect: client 745dd5eb-2b80-4752-9076-ef21465f0c36, cookie 0x5b377f42a7a7da2a 00000100:00080000:2.0:1788748625.996606:0:18854:0:(import.c:65:import_set_state_nolock()) ffff99ceecebc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788748625.996696:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:745dd5eb-2b80-4752-9076-ef21465f0c36+5:2346:x1875638358247424:12345-192.168.203.4@tcp:250:mount.lustre.0 Request processed in 1363us (6932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748625.996706:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 75 00000100:00100000:1.0:1788748626.003097:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748626.003291:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358247552 00000100:00100000:0.0:1788748626.003302:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358247552 00000100:00100000:0.0:1788748626.003360:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 76 00000100:00100000:0.0:1788748626.003370:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:745dd5eb-2b80-4752-9076-ef21465f0c36+5:16694:x1875638358247552:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788748626.003387:0:18857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748626.003404:0:18857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced13e5200/0x5b377f42a7a7da31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521b88 expref: -99 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748626.003432:0:18857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced13e5200/0x5b377f42a7a7da31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b88 expref: 6 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748626.003444:0:18857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced13e5200/0x5b377f42a7a7da31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b88 expref: 6 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748626.003462:0:18857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e5200, rc 0) 00000100:00100000:0.0:1788748626.003603:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:745dd5eb-2b80-4752-9076-ef21465f0c36+6:16694:x1875638358247552:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 234us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748626.003628:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 76 00000100:00100000:1.0:1788748626.007362:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748626.007605:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358247680 00000100:00100000:2.0:1788748626.007615:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358247680 00000100:00100000:2.0:1788748626.007670:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:2.0:1788748626.007679:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:745dd5eb-2b80-4752-9076-ef21465f0c36+6:16694:x1875638358247680:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788748626.009489:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:745dd5eb-2b80-4752-9076-ef21465f0c36+6:16694:x1875638358247680:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 1804us (2128us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788748626.010106:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:1.0:1788748626.011997:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748626.012394:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358247808 00000100:00100000:2.0:1788748626.012404:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358247808 00000100:00100000:2.0:1788748626.012471:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 78 00000100:00100000:2.0:1788748626.012492:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:745dd5eb-2b80-4752-9076-ef21465f0c36+6:16694:x1875638358247808:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788748626.012515:0:18856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748626.012533:0:18856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc8feae00/0x5b377f42a7a7da38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521b8f expref: -99 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748626.012564:0:18856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc8feae00/0x5b377f42a7a7da38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b8f expref: 7 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748626.012575:0:18856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc8feae00/0x5b377f42a7a7da38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521b8f expref: 7 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748626.012584:0:18856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc8feae00, rc 0) 00000100:00100000:2.0:1788748626.012642:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:745dd5eb-2b80-4752-9076-ef21465f0c36+7:16694:x1875638358247808:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 162us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748626.012650:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 78 00000100:00100000:1.0:1788748626.017670:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748626.018097:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358247936 00000100:00100000:2.0:1788748626.018111:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358247936 00000100:00100000:2.0:1788748626.018196:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 79 00000100:00100000:2.0:1788748626.018209:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:745dd5eb-2b80-4752-9076-ef21465f0c36+7:16694:x1875638358247936:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788748626.018658:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:745dd5eb-2b80-4752-9076-ef21465f0c36+8:16694:x1875638358247936:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 449us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748626.018669:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 79 00010000:00010000:2.0:1788748626.030277:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748626.037181:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748626.037332:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358248064 00000100:00100000:0.0:1788748626.037346:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358248064 00000100:00100000:0.0:1788748626.037424:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 80 00000100:00100000:0.0:1788748626.037435:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:745dd5eb-2b80-4752-9076-ef21465f0c36+8:16694:x1875638358248064:12345-192.168.203.4@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788748626.039387:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:745dd5eb-2b80-4752-9076-ef21465f0c36+8:16694:x1875638358248064:12345-192.168.203.4@tcp:503:mount.lustre.0 Request processed in 1940us (2208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748626.039404:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 80 00000100:00100000:0.0:1788748626.049427:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748626.049834:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358248192 00000100:00100000:2.0:1788748626.049854:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358248192 00000100:00100000:2.0:1788748626.049947:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 81 00000100:00100000:2.0:1788748626.049960:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:745dd5eb-2b80-4752-9076-ef21465f0c36+8:16712:x1875638358248192:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788748626.050467:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:745dd5eb-2b80-4752-9076-ef21465f0c36+8:16712:x1875638358248192:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 506us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748626.050476:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 81 00000100:00100000:1.0:1788748626.089267:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748626.089378:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358248320 00000100:00100000:0.0:1788748626.089392:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358248320 00000100:00100000:0.0:1788748626.089523:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 82 00000100:00100000:0.0:1788748626.089545:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:745dd5eb-2b80-4752-9076-ef21465f0c36+8:16712:x1875638358248320:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788748626.089952:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:745dd5eb-2b80-4752-9076-ef21465f0c36+8:16712:x1875638358248320:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 417us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748626.089961:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 82 00000100:00100000:1.0:1788748626.098121:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748626.098505:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358248448 00000100:00100000:3.0:1788748626.098520:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358248448 00000100:00100000:3.0:1788748626.098601:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 83 00000100:00100000:3.0:1788748626.098613:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceece86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:745dd5eb-2b80-4752-9076-ef21465f0c36+8:16694:x1875638358248448:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788748626.098637:0:18856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748626.098661:0:18856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ceecec3400/0x5b377f42a7a7da3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521bb9 expref: -99 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748626.098698:0:18856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ceecec3400/0x5b377f42a7a7da3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521bb9 expref: 9 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748626.098730:0:18856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ceecec3400/0x5b377f42a7a7da3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521bb9 expref: 9 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748626.098742:0:18856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec3400, rc 0) 00000100:00100000:3.0:1788748626.098815:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceece86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:745dd5eb-2b80-4752-9076-ef21465f0c36+9:16694:x1875638358248448:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 204us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748626.098822:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 83 00000100:00100000:1.0:1788748626.103301:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748626.103461:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358248576 00000100:00100000:3.0:1788748626.103475:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358248576 00000100:00100000:3.0:1788748626.103654:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 84 00000100:00100000:3.0:1788748626.103668:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2302050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:745dd5eb-2b80-4752-9076-ef21465f0c36+9:16694:x1875638358248576:12345-192.168.203.4@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788748626.103705:0:18856:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788748626.103736:0:18856:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788748626.103741:0:18856:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788748626.103744:0:18856:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788748626.103746:0:18856:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:3.0:1788748626.108582:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2302050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:745dd5eb-2b80-4752-9076-ef21465f0c36+9:16694:x1875638358248576:12345-192.168.203.4@tcp:256:mount.lustre.0 Request processed in 4901us (5281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748626.108601:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 84 00000100:00100000:1.0:1788748626.114417:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748626.114541:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358248704 00000100:00100000:0.0:1788748626.114555:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358248704 00000100:00100000:0.0:1788748626.114626:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 85 00000100:00100000:0.0:1788748626.114639:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:745dd5eb-2b80-4752-9076-ef21465f0c36+9:16694:x1875638358248704:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788748626.114663:0:18857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748626.114688:0:18857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced13e4600/0x5b377f42a7a7da46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521bc0 expref: -99 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748626.114727:0:18857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced13e4600/0x5b377f42a7a7da46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521bc0 expref: 10 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748626.114761:0:18857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced13e4600/0x5b377f42a7a7da46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521bc0 expref: 10 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748626.114772:0:18857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e4600, rc 0) 00000100:00100000:0.0:1788748626.114850:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:745dd5eb-2b80-4752-9076-ef21465f0c36+10:16694:x1875638358248704:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 214us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748626.114857:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 85 00000100:00100000:1.0:1788748626.119731:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748626.119833:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358248832 00000100:00100000:3.0:1788748626.119847:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358248832 00000100:00100000:3.0:1788748626.119940:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 86 00000100:00100000:3.0:1788748626.119952:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2302450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:745dd5eb-2b80-4752-9076-ef21465f0c36+10:16694:x1875638358248832:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788748626.120407:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2302450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:745dd5eb-2b80-4752-9076-ef21465f0c36+10:16694:x1875638358248832:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 456us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748626.120429:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 86 00000100:00100000:1.0:1788748626.134769:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748626.134885:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358248960 00000100:00100000:2.0:1788748626.134910:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358248960 00000100:00100000:2.0:1788748626.135306:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 87 00000100:00100000:2.0:1788748626.135321:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:745dd5eb-2b80-4752-9076-ef21465f0c36+10:16694:x1875638358248960:12345-192.168.203.4@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788748626.135829:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:745dd5eb-2b80-4752-9076-ef21465f0c36+10:16694:x1875638358248960:12345-192.168.203.4@tcp:503:mount.lustre.0 Request processed in 508us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748626.135840:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 87 00000100:00100000:1.0:1788748626.143558:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748626.144144:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358249088 00000100:00100000:0.0:1788748626.144160:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358249088 00000100:00100000:0.0:1788748626.144231:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 88 00000100:00100000:0.0:1788748626.144243:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:745dd5eb-2b80-4752-9076-ef21465f0c36+10:16717:x1875638358249088:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788748626.144652:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:745dd5eb-2b80-4752-9076-ef21465f0c36+10:16717:x1875638358249088:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 409us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748626.144661:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 88 00000100:00100000:1.0:1788748626.163825:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748626.163920:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358249216 00000100:00100000:0.0:1788748626.163940:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358249216 00000100:00100000:0.0:1788748626.164052:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 89 00000100:00100000:0.0:1788748626.164066:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2302850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:745dd5eb-2b80-4752-9076-ef21465f0c36+10:16717:x1875638358249216:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788748626.164409:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2302850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:745dd5eb-2b80-4752-9076-ef21465f0c36+10:16717:x1875638358249216:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 343us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748626.164418:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 89 00000100:00100000:1.0:1788748626.175065:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748626.175502:0:18862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358249344 00000100:00100000:3.0:1788748626.175519:0:18862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358249344 00000100:00100000:3.0:1788748626.175586:0:18862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:3.0:1788748626.175597:0:18862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2346:x1875638358249344:12345-192.168.203.4@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788748626.175636:0:18862:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from d4430730-ba8d-423d-b041-116ce5a3d089@192.168.203.4@tcp t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:3.0:1788748626.175737:0:18862:0:(genops.c:1384:class_connect()) connect: client d4430730-ba8d-423d-b041-116ce5a3d089, cookie 0x5b377f42a7a7da4d 00000004:00100000:3.0:1788748626.175778:0:18862:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788748626.175785:0:18862:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:1.0:1788748626.241944:0:18862:0:(import.c:65:import_set_state_nolock()) ffff99cf01944000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788748626.242077:0:18862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4430730-ba8d-423d-b041-116ce5a3d089+6:2346:x1875638358249344:12345-192.168.203.4@tcp:38:mount.lustre.0 Request processed in 66479us (67070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748626.242088:0:18862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:1.0:1788748626.246590:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748626.249906:0:18864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358249472 00000100:00100000:3.0:1788748626.249929:0:18864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358249472 00000100:00100000:3.0:1788748626.250309:0:18864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:3.0:1788748626.250323:0:18864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4430730-ba8d-423d-b041-116ce5a3d089+6:0:x1875638358249472:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788748626.250385:0:18864:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:0.0:1788748626.250439:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748626.251951:0:18864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4430730-ba8d-423d-b041-116ce5a3d089+6:0:x1875638358249472:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 1621us (5365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748626.251966:0:18864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:0.0:1788748626.252528:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748626.252737:0:19570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358249600 00000100:00100000:3.0:1788748626.252751:0:19570:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358249600 00000100:00100000:3.0:1788748626.253598:0:19570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:3.0:1788748626.253614:0:19570:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4430730-ba8d-423d-b041-116ce5a3d089+6:16694:x1875638358249600:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788748626.255301:0:19570:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788748626.255424:0:19570:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4430730-ba8d-423d-b041-116ce5a3d089+6:16694:x1875638358249600:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 1808us (2897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748626.255440:0:19570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:0.0:1788748626.257505:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748626.257597:0:18864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358249728 00000100:00100000:3.0:1788748626.257614:0:18864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358249728 00000100:00100000:3.0:1788748626.257697:0:18864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:3.0:1788748626.257709:0:18864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4430730-ba8d-423d-b041-116ce5a3d089+6:16694:x1875638358249728:12345-192.168.203.4@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788748626.257847:0:18864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4430730-ba8d-423d-b041-116ce5a3d089+6:16694:x1875638358249728:12345-192.168.203.4@tcp:40:mount.lustre.0 Request processed in 139us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748626.257864:0:18864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:1.0:1788748626.260800:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748626.260940:0:19548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358249856 00000100:00100000:2.0:1788748626.260955:0:19548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358249856 00000100:00100000:2.0:1788748626.261066:0:19548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:2.0:1788748626.261076:0:19548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2346:x1875638358249856:12345-192.168.203.4@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788748626.261133:0:19548:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from d4430730-ba8d-423d-b041-116ce5a3d089@192.168.203.4@tcp t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:2.0:1788748626.261177:0:19548:0:(genops.c:1384:class_connect()) connect: client d4430730-ba8d-423d-b041-116ce5a3d089, cookie 0x5b377f42a7a7da54 00002000:00100000:2.0:1788748626.261193:0:19548:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d4430730-ba8d-423d-b041-116ce5a3d089/ffff99cdc643d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788748626.261243:0:19548:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788748626.261664:0:19548:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788748626.261708:0:19548:0:(import.c:65:import_set_state_nolock()) ffff99cec50a9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788748626.261795:0:19548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4430730-ba8d-423d-b041-116ce5a3d089+6:2346:x1875638358249856:12345-192.168.203.4@tcp:8:mount.lustre.0 Request processed in 719us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748626.261804:0:19548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:1.0:1788748626.262839:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748626.263011:0:19549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358249984 00000100:00100000:3.0:1788748626.263061:0:19549:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358249984 00000100:00100000:3.0:1788748626.263108:0:19549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:3.0:1788748626.263117:0:19549:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1875638358249984:12345-192.168.203.4@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788748626.263153:0:19549:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from d4430730-ba8d-423d-b041-116ce5a3d089@192.168.203.4@tcp t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:3.0:1788748626.263188:0:19549:0:(genops.c:1384:class_connect()) connect: client d4430730-ba8d-423d-b041-116ce5a3d089, cookie 0x5b377f42a7a7da5b 00002000:00100000:3.0:1788748626.263203:0:19549:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d4430730-ba8d-423d-b041-116ce5a3d089/ffff99ced02b7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788748626.263231:0:19549:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788748626.263591:0:19549:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788748626.263625:0:19549:0:(import.c:65:import_set_state_nolock()) ffff99ced02b0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788748626.263687:0:19549:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4430730-ba8d-423d-b041-116ce5a3d089+6:2346:x1875638358249984:12345-192.168.203.4@tcp:8:mount.lustre.0 Request processed in 571us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748626.263696:0:19549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:1.0:1788748626.269230:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748626.269386:0:18865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358250112 00000100:00100000:3.0:1788748626.269399:0:18865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358250112 00000100:00100000:3.0:1788748626.269473:0:18865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:3.0:1788748626.269486:0:18865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4430730-ba8d-423d-b041-116ce5a3d089+6:16694:x1875638358250112:12345-192.168.203.4@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788748626.277902:0:18865:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 8316us 00000004:00200000:3.0:1788748626.300712:0:18865:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788748626.300836:0:18865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4430730-ba8d-423d-b041-116ce5a3d089+6:16694:x1875638358250112:12345-192.168.203.4@tcp:33:mount.lustre.0 Request processed in 31349us (31616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748626.300857:0:18865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:2.0:1788748626.549382:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748626.549525:0:18863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358250240 00000100:00100000:3.0:1788748626.549543:0:18863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358250240 00000100:00100000:3.0:1788748626.549627:0:18863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:3.0:1788748626.549645:0:18863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4430730-ba8d-423d-b041-116ce5a3d089+6:16738:x1875638358250240:12345-192.168.203.4@tcp:101:mkdir.0 00010000:00010000:3.0:1788748626.549674:0:18863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748626.549708:0:18863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7da62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521bea expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748626.549795:0:18863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7da69 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748626.549812:0:18863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7da69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748626.549832:0:18863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7da69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748626.549880:0:18863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788748626.549885:0:18863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788748626.550057:0:18863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7da69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748626.550116:0:18863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7da62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521bea expref: 8 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748626.551944:0:18863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7da69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521bea expref: 7 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748626.551963:0:18863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646f00) 00010000:00010000:0.0:1788748626.551966:0:18863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788748626.551970:0:18863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec3e00, rc 0) 00000100:00100000:0.0:1788748626.552067:0:18863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4430730-ba8d-423d-b041-116ce5a3d089+7:16738:x1875638358250240:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 2428us (2692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748626.552076:0:18863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00010000:00010000:1.0:1788748627.053203:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748628.077985:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788748628.239148:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d4430730-ba8d-423d-b041-116ce5a3d089 00000100:00100000:1.0:1788748628.574885:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748628.574994:0:18862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358250368 00000100:00100000:0.0:1788748628.575004:0:18862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358250368 00000100:00100000:0.0:1788748628.575105:0:18862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:0.0:1788748628.575116:0:18862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4430730-ba8d-423d-b041-116ce5a3d089+7:16790:x1875638358250368:12345-192.168.203.4@tcp:41:lfs.0 00000004:00000024:0.0:1788748628.575156:0:18862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788748628.575255:0:18862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4430730-ba8d-423d-b041-116ce5a3d089+7:16790:x1875638358250368:12345-192.168.203.4@tcp:41:lfs.0 Request processed in 140us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748628.575262:0:18862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00080000:3.0:1788748628.575766:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748628.579134:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748628.579471:0:19550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358250496 00000100:00100000:3.0:1788748628.579488:0:19550:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358250496 00000100:00100000:3.0:1788748628.579610:0:19550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:3.0:1788748628.579635:0:19550:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d4430730-ba8d-423d-b041-116ce5a3d089+6:16790:x1875638358250496:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:3.0:1788748628.579689:0:19550:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788748628.580338:0:19550:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d4430730-ba8d-423d-b041-116ce5a3d089+6:16790:x1875638358250496:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 703us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748628.580368:0:19550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00080000:0.0:1788748628.580479:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788748628.587720:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748628.587905:0:19551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358250624 00000100:00100000:1.0:1788748628.587983:0:19551:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358250624 00000100:00080000:0.0:1788748628.588140:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788748628.588275:0:19551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:1.0:1788748628.588288:0:19551:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d4430730-ba8d-423d-b041-116ce5a3d089+5:16790:x1875638358250624:12345-192.168.203.4@tcp:13:lfs.0 00002000:00000024:1.0:1788748628.588339:0:19551:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788748628.588460:0:19551:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d4430730-ba8d-423d-b041-116ce5a3d089+5:16790:x1875638358250624:12345-192.168.203.4@tcp:13:lfs.0 Request processed in 173us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748628.588468:0:19551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:3.0:1788748628.717396:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788748628.717428:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377116288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788748628.717534:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748628.717647:0:19550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377116288 00000100:00100000:3.0:1788748628.717657:0:19550:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377116288 00000100:00100000:3.0:1788748628.717737:0:19550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788748628.717749:0:19550:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377116288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788748628.717778:0:19550:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788748628.717834:0:19550:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377116288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748628.717843:0:19550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788748628.717878:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ddbae60-91f9-474f-9a47-689ab5e32951:3308:1875638377116544:0@lo:400:kworker.0 00000100:00100000:0.0:1788748628.717898:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377116672:0@lo:400:kworker.0 00000100:00100000:3.0:1788748628.717919:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748628.717954:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875638377117056:0@lo:400:kworker.0 00000100:00100000:0.0:1788748628.717958:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748628.717994:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788748628.718007:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788748628.718081:0:19570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377117056 00000100:00100000:3.0:1788748628.718084:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377116416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748628.718087:0:19570:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377117056 00000100:00100000:3.0:1788748628.718116:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748628.718142:0:19570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788748628.718145:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875638377116928:0@lo:400:kworker.0 00000100:00100000:0.0:1788748628.718155:0:19570:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875638377117056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748628.718176:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748628.718214:0:19570:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875638377117056:12345-0@lo:400:kworker.0 Request processed in 63us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748628.718223:0:19570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788748628.718233:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377116288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788748628.718238:0:19570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377116928 00000100:00100000:0.0:1788748628.718243:0:19570:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377116928 00000100:00100000:3.0:1788748628.718259:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788748628.718269:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377116800:0@lo:400:kworker.0 00000100:00100000:0.0:1788748628.718274:0:19570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788748628.718284:0:19570:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875638377116928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748628.718302:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748628.718379:0:18864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377116800 00000100:00100000:1.0:1788748628.718385:0:18864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377116800 00000100:00100000:1.0:1788748628.718410:0:18864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788748628.718417:0:18864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377116800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748628.718514:0:19548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377116672 00000100:00100000:2.0:1788748628.718519:0:19548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377116672 00000100:00100000:2.0:1788748628.718556:0:19548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788748628.718563:0:19548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377116672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748628.720132:0:19570:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875638377116928:12345-0@lo:400:kworker.0 Request processed in 1839us (1946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748628.720147:0:19570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788748628.720222:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377116544 00000100:00100000:0.0:1788748628.720230:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377116544 00000100:00100000:3.0:1788748628.720232:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875638377116928:0@lo:400:kworker.0 00000100:00100000:0.0:1788748628.720286:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788748628.720294:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875638377117056:0@lo:400:kworker.0 00000100:00100000:0.0:1788748628.720298:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+19:3308:x1875638377116544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748628.720335:0:19550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377116416 00000100:00100000:3.0:1788748628.720340:0:19550:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377116416 00000100:00100000:3.0:1788748628.720371:0:19550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788748628.720376:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+19:3308:x1875638377116544:12345-0@lo:400:kworker.0 Request processed in 82us (2458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748628.720383:0:19550:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875638377116416:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748628.720389:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00002000:00000024:3.0:1788748628.720405:0:19550:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00080000:0.0:1788748628.720446:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788748628.720454:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748628.720466:0:19550:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875638377116416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (2349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748628.720475:0:19550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788748628.720505:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ddbae60-91f9-474f-9a47-689ab5e32951:3308:1875638377116544:0@lo:400:kworker.0 00000100:00100000:3.0:1788748628.720544:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377116416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788748628.720648:0:18864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875638377116800:12345-0@lo:400:kworker.0 Request processed in 2229us (2345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748628.720657:0:18864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788748628.720750:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875638377116800:0@lo:400:kworker.0 00000100:00100000:2.0:1788748628.720909:0:19548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377116672:12345-0@lo:400:kworker.0 Request processed in 2345us (2952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748628.720920:0:19548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788748628.722185:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377116672:0@lo:400:kworker.0 00000100:00100000:1.0:1788748628.756761:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748628.756900:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358250752 00000100:00100000:0.0:1788748628.756914:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358250752 00000100:00100000:0.0:1788748628.756988:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 91 00000100:00100000:0.0:1788748628.756999:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2301c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:745dd5eb-2b80-4752-9076-ef21465f0c36+10:16821:x1875638358250752:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788748628.757084:0:18857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748628.757109:0:18857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced13e5600/0x5b377f42a7a7da70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521bf1 expref: -99 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748628.757160:0:18857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced13e5600/0x5b377f42a7a7da70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521bf1 expref: 11 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748628.757173:0:18857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced13e5600/0x5b377f42a7a7da70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521bf1 expref: 11 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748628.757184:0:18857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e5600, rc 0) 00000100:00100000:0.0:1788748628.757260:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2301c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:745dd5eb-2b80-4752-9076-ef21465f0c36+11:16821:x1875638358250752:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 262us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748628.757269:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 91 00000100:00100000:0.0:1788748628.765065:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748628.771340:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358250880 00000100:00100000:2.0:1788748628.771361:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358250880 00000100:00100000:2.0:1788748628.771457:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 92 00000100:00100000:2.0:1788748628.771469:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:745dd5eb-2b80-4752-9076-ef21465f0c36+11:16821:x1875638358250880:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788748628.771867:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:745dd5eb-2b80-4752-9076-ef21465f0c36+11:16821:x1875638358250880:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 398us (6814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748628.771876:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 92 00000100:00100000:2.0:1788748628.776804:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748628.777149:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358251008 00000100:00100000:3.0:1788748628.777162:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358251008 00000100:00100000:3.0:1788748628.777235:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 93 00000100:00100000:3.0:1788748628.777247:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:745dd5eb-2b80-4752-9076-ef21465f0c36+11:16821:x1875638358251008:12345-192.168.203.4@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788748628.777581:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:745dd5eb-2b80-4752-9076-ef21465f0c36+11:16821:x1875638358251008:12345-192.168.203.4@tcp:503:mount.lustre.0 Request processed in 335us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748628.777590:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 93 00000100:00100000:1.0:1788748628.804346:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748628.807037:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358251136 00000100:00100000:0.0:1788748628.807059:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358251136 00000100:00100000:0.0:1788748628.807165:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 94 00000100:00100000:0.0:1788748628.807178:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2301450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:745dd5eb-2b80-4752-9076-ef21465f0c36+11:16829:x1875638358251136:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788748628.807585:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2301450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:745dd5eb-2b80-4752-9076-ef21465f0c36+11:16829:x1875638358251136:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 408us (3251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748628.807594:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 94 00000100:00100000:0.0:1788748628.838769:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748628.838879:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358251264 00000100:00100000:2.0:1788748628.838892:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358251264 00000100:00100000:2.0:1788748628.838966:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 95 00000100:00100000:2.0:1788748628.838980:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2301850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:745dd5eb-2b80-4752-9076-ef21465f0c36+11:16829:x1875638358251264:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788748628.842389:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2301850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:745dd5eb-2b80-4752-9076-ef21465f0c36+11:16829:x1875638358251264:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 3395us (3616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748628.842408:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 95 00000100:00100000:2.0:1788748628.855778:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748628.855905:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358251392 00000100:00100000:0.0:1788748628.855920:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358251392 00000100:00100000:0.0:1788748628.856002:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 96 00000100:00100000:0.0:1788748628.856065:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:745dd5eb-2b80-4752-9076-ef21465f0c36+11:16821:x1875638358251392:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788748628.856110:0:18857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748628.856136:0:18857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ced13e4800/0x5b377f42a7a7da77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521c1b expref: -99 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748628.856174:0:18857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ced13e4800/0x5b377f42a7a7da77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c1b expref: 12 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748628.856187:0:18857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ced13e4800/0x5b377f42a7a7da77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c1b expref: 12 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748628.856196:0:18857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e4800, rc 0) 00000100:00100000:0.0:1788748628.856265:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:745dd5eb-2b80-4752-9076-ef21465f0c36+12:16821:x1875638358251392:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 252us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748628.856272:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 96 00000100:00100000:1.0:1788748628.861890:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748628.862072:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358251520 00000100:00100000:2.0:1788748628.862086:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358251520 00000100:00100000:2.0:1788748628.862148:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 97 00000100:00100000:2.0:1788748628.862161:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ced2300c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:745dd5eb-2b80-4752-9076-ef21465f0c36+12:16821:x1875638358251520:12345-192.168.203.4@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788748628.862195:0:18854:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788748628.862227:0:18854:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788748628.862231:0:18854:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788748628.862235:0:18854:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788748628.862237:0:18854:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:2.0:1788748628.867252:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ced2300c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:745dd5eb-2b80-4752-9076-ef21465f0c36+12:16821:x1875638358251520:12345-192.168.203.4@tcp:256:mount.lustre.0 Request processed in 5077us (5359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748628.867271:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 97 00000100:00100000:1.0:1788748628.880167:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748628.880368:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358251648 00000100:00100000:3.0:1788748628.880381:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358251648 00000100:00100000:3.0:1788748628.880456:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 98 00000100:00100000:3.0:1788748628.880466:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd83a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:745dd5eb-2b80-4752-9076-ef21465f0c36+12:16821:x1875638358251648:12345-192.168.203.4@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788748628.880509:0:18856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748628.880533:0:18856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ceecec2400/0x5b377f42a7a7da7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521c22 expref: -99 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748628.880576:0:18856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ceecec2400/0x5b377f42a7a7da7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c22 expref: 13 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748628.880591:0:18856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ceecec2400/0x5b377f42a7a7da7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c22 expref: 13 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748628.880602:0:18856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2400, rc 0) 00000100:00100000:3.0:1788748628.880678:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd83a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:745dd5eb-2b80-4752-9076-ef21465f0c36+13:16821:x1875638358251648:12345-192.168.203.4@tcp:101:mount.lustre.0 Request processed in 212us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748628.880686:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 98 00000100:00100000:1.0:1788748628.883417:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748628.883541:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358251776 00000100:00100000:2.0:1788748628.883554:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358251776 00000100:00100000:2.0:1788748628.883620:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 99 00000100:00100000:2.0:1788748628.883633:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd83a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:745dd5eb-2b80-4752-9076-ef21465f0c36+13:16821:x1875638358251776:12345-192.168.203.4@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788748628.884354:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd83a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:745dd5eb-2b80-4752-9076-ef21465f0c36+13:16821:x1875638358251776:12345-192.168.203.4@tcp:501:mount.lustre.0 Request processed in 718us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748628.884366:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 99 00000100:00100000:1.0:1788748628.889795:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748628.890054:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358251904 00000100:00100000:0.0:1788748628.890068:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358251904 00000100:00100000:0.0:1788748628.890142:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 100 00000100:00100000:0.0:1788748628.890153:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd838050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:745dd5eb-2b80-4752-9076-ef21465f0c36+13:16821:x1875638358251904:12345-192.168.203.4@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788748628.890482:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd838050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:745dd5eb-2b80-4752-9076-ef21465f0c36+13:16821:x1875638358251904:12345-192.168.203.4@tcp:503:mount.lustre.0 Request processed in 330us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748628.890491:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 100 00000100:00100000:1.0:1788748628.892812:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748628.893078:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358252032 00000100:00100000:2.0:1788748628.893091:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358252032 00000100:00100000:2.0:1788748628.893152:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 101 00000100:00100000:2.0:1788748628.893182:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd838450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:745dd5eb-2b80-4752-9076-ef21465f0c36+13:16835:x1875638358252032:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788748628.893512:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd838450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:745dd5eb-2b80-4752-9076-ef21465f0c36+13:16835:x1875638358252032:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 331us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748628.893521:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 101 00000100:00100000:1.0:1788748628.906952:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748628.907206:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358252160 00000100:00100000:3.0:1788748628.907220:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358252160 00000100:00100000:3.0:1788748628.907286:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 102 00000100:00100000:3.0:1788748628.907297:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd83bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:745dd5eb-2b80-4752-9076-ef21465f0c36+13:16835:x1875638358252160:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788748628.907611:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd83bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:745dd5eb-2b80-4752-9076-ef21465f0c36+13:16835:x1875638358252160:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 314us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748628.907619:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 102 00000100:00100000:1.0:1788748628.911634:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748628.911690:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748628.911793:0:18862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358252288 00000100:00100000:3.0:1788748628.911809:0:18862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358252288 00000100:00100000:3.0:1788748628.911884:0:18862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358252672 00000100:00100000:3.0:1788748628.911888:0:18862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358252672 00000100:00100000:3.0:1788748628.911949:0:18862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:3.0:1788748628.911962:0:18862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4430730-ba8d-423d-b041-116ce5a3d089+7:2347:x1875638358252672:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788748628.912131:0:18862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4430730-ba8d-423d-b041-116ce5a3d089+7:2347:x1875638358252672:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 171us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748628.912140:0:18862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:3.0:1788748628.912165:0:18862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:3.0:1788748628.912170:0:18862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2346:x1875638358252288:12345-192.168.203.4@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788748628.912199:0:18862:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from dd074acc-e2d0-4043-bc1b-1aea376ea903@192.168.203.4@tcp t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:3.0:1788748628.912246:0:18862:0:(genops.c:1384:class_connect()) connect: client dd074acc-e2d0-4043-bc1b-1aea376ea903, cookie 0x5b377f42a7a7da85 00000004:00100000:3.0:1788748628.912289:0:18862:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788748628.912455:0:18862:0:(import.c:65:import_set_state_nolock()) ffff99cef68b3000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788748628.912493:0:18862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd074acc-e2d0-4043-bc1b-1aea376ea903+6:2346:x1875638358252288:12345-192.168.203.4@tcp:38:mount.lustre.0 Request processed in 320us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748628.912501:0:18862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:1.0:1788748628.914933:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748628.914981:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748628.919157:0:20347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358252800 00000100:00100000:0.0:1788748628.919191:0:20347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358252800 00000100:00100000:0.0:1788748628.919339:0:20347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358252928 00000100:00100000:0.0:1788748628.919343:0:20347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358252928 00000100:00100000:0.0:1788748628.919386:0:20347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:0.0:1788748628.919398:0:20347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4430730-ba8d-423d-b041-116ce5a3d089+6:2348:x1875638358252800:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748628.919518:0:19548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:2.0:1788748628.919530:0:19548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4430730-ba8d-423d-b041-116ce5a3d089+5:2347:x1875638358252928:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748628.919642:0:19548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4430730-ba8d-423d-b041-116ce5a3d089+5:2347:x1875638358252928:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 115us (4660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748628.919650:0:19548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:0.0:1788748628.920198:0:20347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4430730-ba8d-423d-b041-116ce5a3d089+6:2348:x1875638358252800:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 797us (5283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748628.920206:0:20347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:1.0:1788748628.922601:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748628.922696:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748628.922890:0:18862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358252416 00000100:00100000:0.0:1788748628.922903:0:18862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358252416 00000100:00080000:1.0:1788748628.923173:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748628.923967:0:18862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358252544 00000100:00100000:0.0:1788748628.923978:0:18862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358252544 00000100:00100000:2.0:1788748628.925210:0:18864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:2.0:1788748628.925230:0:18864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd074acc-e2d0-4043-bc1b-1aea376ea903+7:0:x1875638358252416:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788748628.925277:0:18864:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788748628.925391:0:18864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd074acc-e2d0-4043-bc1b-1aea376ea903+7:0:x1875638358252416:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 167us (2802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748628.925398:0:18864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:2.0:1788748628.925442:0:18864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:2.0:1788748628.925450:0:18864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd074acc-e2d0-4043-bc1b-1aea376ea903+6:16821:x1875638358252544:12345-192.168.203.4@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788748628.925462:0:18864:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788748628.925485:0:18864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd074acc-e2d0-4043-bc1b-1aea376ea903+6:16821:x1875638358252544:12345-192.168.203.4@tcp:41:mount.lustre.0 Request processed in 37us (2790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748628.925492:0:18864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:0.0:1788748628.929233:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748628.929403:0:19570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358253056 00000100:00100000:1.0:1788748628.929477:0:19570:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358253056 00000100:00100000:1.0:1788748628.929589:0:19570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:1.0:1788748628.929603:0:19570:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd074acc-e2d0-4043-bc1b-1aea376ea903+6:16821:x1875638358253056:12345-192.168.203.4@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788748628.929727:0:19570:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd074acc-e2d0-4043-bc1b-1aea376ea903+6:16821:x1875638358253056:12345-192.168.203.4@tcp:40:mount.lustre.0 Request processed in 127us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748628.929735:0:19570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:0.0:1788748628.938287:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748628.938333:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748628.938365:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748628.938406:0:19549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358253184 00000100:00100000:0.0:1788748628.938419:0:19549:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358253184 00000100:00100000:0.0:1788748628.938473:0:19549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358253312 00000100:00100000:0.0:1788748628.938476:0:19549:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358253312 00000100:00100000:0.0:1788748628.938503:0:19549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:0.0:1788748628.938513:0:19549:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1875638358253184:12345-192.168.203.4@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788748628.938553:0:19549:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from dd074acc-e2d0-4043-bc1b-1aea376ea903@192.168.203.4@tcp t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:0.0:1788748628.938590:0:19549:0:(genops.c:1384:class_connect()) connect: client dd074acc-e2d0-4043-bc1b-1aea376ea903, cookie 0x5b377f42a7a7da8c 00002000:00100000:0.0:1788748628.938606:0:19549:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dd074acc-e2d0-4043-bc1b-1aea376ea903/ffff99cdc817a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788748628.938622:0:19549:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788748628.938754:0:19549:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788748628.938790:0:19549:0:(import.c:65:import_set_state_nolock()) ffff99cdc817a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788748628.941294:0:19547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:1.0:1788748628.941309:0:19547:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1875638358253312:12345-192.168.203.4@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788748628.941355:0:19547:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from dd074acc-e2d0-4043-bc1b-1aea376ea903@192.168.203.4@tcp t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:1.0:1788748628.941396:0:19547:0:(genops.c:1384:class_connect()) connect: client dd074acc-e2d0-4043-bc1b-1aea376ea903, cookie 0x5b377f42a7a7da93 00002000:00100000:1.0:1788748628.941411:0:19547:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli dd074acc-e2d0-4043-bc1b-1aea376ea903/ffff99cee516c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788748628.941426:0:19547:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788748628.941731:0:19547:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788748628.941763:0:19547:0:(import.c:65:import_set_state_nolock()) ffff99cee516d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788748628.942206:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358253440 00000100:00100000:3.0:1788748628.942216:0:18866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358253440 00000100:00100000:3.0:1788748628.942267:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:3.0:1788748628.942277:0:18866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd074acc-e2d0-4043-bc1b-1aea376ea903+6:16821:x1875638358253440:12345-192.168.203.4@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788748628.942378:0:18866:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788748628.942492:0:19547:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd074acc-e2d0-4043-bc1b-1aea376ea903+6:2346:x1875638358253312:12345-192.168.203.4@tcp:8:mount.lustre.0 Request processed in 1183us (4123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748628.942501:0:19547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:0.0:1788748628.944188:0:19549:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd074acc-e2d0-4043-bc1b-1aea376ea903+6:2346:x1875638358253184:12345-192.168.203.4@tcp:8:mount.lustre.0 Request processed in 5647us (5825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748628.944206:0:19549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:2.0:1788748628.944665:0:18866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd074acc-e2d0-4043-bc1b-1aea376ea903+6:16821:x1875638358253440:12345-192.168.203.4@tcp:33:mount.lustre.0 Request processed in 2385us (6505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748628.944692:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:3.0:1788748629.077996:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748629.078597:0:18864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358253568 00000100:00100000:1.0:1788748629.078613:0:18864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358253568 00000100:00100000:1.0:1788748629.078743:0:18864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:1.0:1788748629.078756:0:18864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd074acc-e2d0-4043-bc1b-1aea376ea903+6:16856:x1875638358253568:12345-192.168.203.4@tcp:101:mkdir.0 00010000:00010000:1.0:1788748629.078784:0:18864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748629.078815:0:18864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7da9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521c4c expref: -99 pid: 18864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748629.078901:0:18864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7daa1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748629.078918:0:18864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7daa1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748629.078933:0:18864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7daa1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748629.078982:0:18864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788748629.078987:0:18864:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788748629.079046:0:18864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7daa1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748629.079076:0:18864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7da9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c4c expref: 8 pid: 18864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748629.079098:0:18864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7daa1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c4c expref: 7 pid: 18864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748629.079107:0:18864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646f00) 00010000:00010000:1.0:1788748629.079110:0:18864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788748629.079131:0:18864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f8600, rc 0) 00000100:00100000:1.0:1788748629.079220:0:18864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd074acc-e2d0-4043-bc1b-1aea376ea903+7:16856:x1875638358253568:12345-192.168.203.4@tcp:101:mkdir.0 Request processed in 466us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748629.079228:0:18864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14 00010000:00010000:2.0:1788748629.101347:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748630.125371:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748631.150219:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788748631.315787:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dd074acc-e2d0-4043-bc1b-1aea376ea903 00000001:00100000:1.0:1788748631.315806:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d4430730-ba8d-423d-b041-116ce5a3d089 00000001:00100000:0.0:1788748631.326337:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d4430730-ba8d-423d-b041-116ce5a3d089 00000001:00100000:0.0:1788748631.326354:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of dd074acc-e2d0-4043-bc1b-1aea376ea903 00000001:02000400:3.0:1788748631.701832:0:20828:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788748632.174897:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748633.198263:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788748633.382101:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dd074acc-e2d0-4043-bc1b-1aea376ea903 00000100:00100000:3.0:1788748633.837219:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377117184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748633.837313:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748633.837432:0:19551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377117184 00000100:00100000:3.0:1788748633.837442:0:19551:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377117184 00000100:00100000:3.0:1788748633.837519:0:19551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788748633.837533:0:19551:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377117184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788748633.837582:0:19551:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788748633.837671:0:19551:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377117184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748633.837682:0:19551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788748633.837716:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788748633.837785:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377117184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748633.838331:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788748633.838346:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377117312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788748633.838390:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748633.838542:0:19551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377117312 00000100:00100000:1.0:1788748633.838550:0:19551:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377117312 00000100:00100000:1.0:1788748633.838605:0:19551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788748633.838614:0:19551:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377117312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788748633.838645:0:19551:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788748633.838691:0:19551:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377117312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748633.838698:0:19551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788748633.838784:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377117312:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788748633.838990:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788748633.839324:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875638377117568:0@lo:400:kworker.0 00000100:00100000:3.0:1788748633.839362:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748633.839390:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788748633.839396:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377117696:0@lo:400:kworker.0 00000100:00100000:3.0:1788748633.839430:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748633.839460:0:19570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377117568 00000100:00100000:3.0:1788748633.839465:0:19570:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377117568 00000100:00100000:3.0:1788748633.839497:0:19570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377117696 00000100:00100000:3.0:1788748633.839499:0:19570:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377117696 00000100:00100000:3.0:1788748633.839524:0:19570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788748633.839531:0:19570:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875638377117568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748633.839569:0:19570:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875638377117568:12345-0@lo:400:kworker.0 Request processed in 39us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748633.839576:0:19570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788748633.839590:0:19570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788748633.839595:0:19570:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377117696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748633.839631:0:19570:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377117696:12345-0@lo:400:kworker.0 Request processed in 36us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748633.839637:0:19570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1788748633.839662:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748633.839682:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377117696:0@lo:400:kworker.0 00000100:00100000:3.0:1788748633.839692:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875638377117568:0@lo:400:kworker.0 00000100:00100000:1.0:1788748633.839770:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cee5197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ddbae60-91f9-474f-9a47-689ab5e32951:3307:1875638377117440:0@lo:400:kworker.0 00000100:00100000:1.0:1788748633.839813:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748633.839845:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788748633.839850:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875638377117824:0@lo:400:kworker.0 00000100:00100000:1.0:1788748633.839993:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748633.840785:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377117440 00000100:00100000:3.0:1788748633.841205:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377117440 00000100:00100000:3.0:1788748633.841375:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788748633.841387:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd839c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+19:3307:x1875638377117440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748633.841502:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd839c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+19:3307:x1875638377117440:12345-0@lo:400:kworker.0 Request processed in 117us (1686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748633.841509:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788748633.843798:0:19570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377117824 00000100:00100000:3.0:1788748633.843816:0:19570:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377117824 00000100:00080000:2.0:1788748633.844158:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748633.844244:0:19570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788748633.844260:0:19570:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875638377117824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748633.844547:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875638377117824:0@lo:400:kworker.0 00000100:00100000:3.0:1788748633.844894:0:19570:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875638377117824:12345-0@lo:400:kworker.0 Request processed in 637us (4898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748633.844906:0:19570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788748633.844981:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cee5197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ddbae60-91f9-474f-9a47-689ab5e32951:3307:1875638377117440:0@lo:400:kworker.0 00000100:00100000:2.0:1788748634.156439:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748634.156494:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748634.156524:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748634.156547:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748634.156566:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748634.156583:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748634.156611:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748634.156646:0:19548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358253952 00000100:00100000:2.0:1788748634.156658:0:19548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358253952 00000100:00100000:1.0:1788748634.156687:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358253696 00000100:00100000:1.0:1788748634.156694:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358253696 00000100:00100000:2.0:1788748634.156728:0:19548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358254464 00000100:00100000:2.0:1788748634.156733:0:19548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358254464 00000100:00100000:1.0:1788748634.156741:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 104 00000100:00100000:2.0:1788748634.156754:0:19548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358254080 00000100:00100000:1.0:1788748634.156755:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd83ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:745dd5eb-2b80-4752-9076-ef21465f0c36+13:2348:x1875638358253696:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748634.156759:0:19548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358254080 00000100:00100000:2.0:1788748634.156777:0:19548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358254336 00000100:00100000:2.0:1788748634.156780:0:19548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358254336 00000100:00100000:2.0:1788748634.156795:0:19548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:2.0:1788748634.156803:0:19548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4430730-ba8d-423d-b041-116ce5a3d089+5:2348:x1875638358253952:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748634.156859:0:19548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4430730-ba8d-423d-b041-116ce5a3d089+5:2348:x1875638358253952:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 49us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748634.156868:0:19548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:2.0:1788748634.156900:0:19548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:2.0:1788748634.156907:0:19548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd074acc-e2d0-4043-bc1b-1aea376ea903+5:2348:x1875638358254464:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748634.156975:0:19549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:0.0:1788748634.156985:0:19549:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4430730-ba8d-423d-b041-116ce5a3d089+5:2348:x1875638358254080:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748634.159312:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd83ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:745dd5eb-2b80-4752-9076-ef21465f0c36+13:2348:x1875638358253696:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 2543us (2870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748634.159355:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 104 00000100:00100000:3.0:1788748634.160992:0:19547:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788748634.161030:0:19547:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1788748634.161067:0:18864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358254208 00000100:00100000:3.0:1788748634.161080:0:18864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358254208 00000100:00100000:3.0:1788748634.161156:0:18864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358253824 00000100:00100000:3.0:1788748634.161161:0:18864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358253824 00000100:00100000:3.0:1788748634.161207:0:18864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:1.0:1788748634.161730:0:18863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:3.0:1788748634.161738:0:18864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd074acc-e2d0-4043-bc1b-1aea376ea903+6:2348:x1875638358254208:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748634.161748:0:18863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4430730-ba8d-423d-b041-116ce5a3d089+6:2348:x1875638358253824:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748634.161839:0:18863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4430730-ba8d-423d-b041-116ce5a3d089+6:2348:x1875638358253824:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 97us (5271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748634.161847:0:18863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:2.0:1788748634.161854:0:19548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd074acc-e2d0-4043-bc1b-1aea376ea903+5:2348:x1875638358254464:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 4943us (5301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748634.161867:0:19548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:2.0:1788748634.161892:0:19548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:2.0:1788748634.161902:0:19548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd074acc-e2d0-4043-bc1b-1aea376ea903+5:2348:x1875638358254336:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748634.162664:0:19549:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4430730-ba8d-423d-b041-116ce5a3d089+5:2348:x1875638358254080:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 5672us (6070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748634.162676:0:19549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:3.0:1788748634.162886:0:18864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd074acc-e2d0-4043-bc1b-1aea376ea903+6:2348:x1875638358254208:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 1156us (6359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748634.162895:0:18864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00080000:0.0:1788748634.163364:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788748634.163372:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788748634.163375:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788748634.169354:0:19548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd074acc-e2d0-4043-bc1b-1aea376ea903+5:2348:x1875638358254336:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 7427us (12714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748634.169376:0:19548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00010000:00010000:2.0:1788748634.225517:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788748634.917371:0:20979:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe280548c0 20000000:00000080:2.0:1788748634.917388:0:20979:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99cdc5b19400 uarg=0000000000000000 20000000:01000000:2.0:1788748634.917471:0:20979:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788748634.917477:0:20979:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788748634.917483:0:20979:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788748634.918183:0:20980:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1788748634.918306:0:20979:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788748634.924307:0:20979:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788748634.924337:0:20979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99cec0031a00/0x5b377f42a7a7daa8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748634.924355:0:20979:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ceed6f9400/0x5b377f42a7a7d767 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d760 expref: 18 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748634.924363:0:20979:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ced13e5a00/0x5b377f42a7a7d7b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d7ad expref: 18 pid: 18854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748634.924370:0:20979:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cef6bde800/0x5b377f42a7a7d824 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7d81d expref: 18 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748634.924379:0:20979:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ced13e4600/0x5b377f42a7a7da46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521bc0 expref: 12 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748634.924386:0:20979:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ceecec2400/0x5b377f42a7a7da7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c22 expref: 12 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748634.924419:0:20979:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99cec0031a00/0x5b377f42a7a7daa8 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748634.924463:0:20979:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ceecec2400/0x5b377f42a7a7da7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c22 expref: 12 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748634.924477:0:20979:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ceecec2400/0x5b377f42a7a7da7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c22 expref: 12 pid: 18856 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748634.924492:0:20979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76aad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20979:1875638377117952:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788748634.924630:0:20979:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ced13e4600/0x5b377f42a7a7da46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521bc0 expref: 12 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748634.924638:0:20979:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ced13e4600/0x5b377f42a7a7da46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521bc0 expref: 12 pid: 18857 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748634.924647:0:20979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20979:1875638377118080:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788748634.924678:0:20979:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cef6bde800/0x5b377f42a7a7d824 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7d81d expref: 18 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748634.924687:0:20979:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cef6bde800/0x5b377f42a7a7d824 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7d81d expref: 18 pid: 18857 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748634.924696:0:20979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76a8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20979:1875638377118208:0@lo:104: 00000100:00100000:0.0:1788748634.924735:0:20979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788748634.924774:0:20979:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ced13e5a00/0x5b377f42a7a7d7b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7d7ad expref: 18 pid: 18854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748634.924793:0:20979:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ced13e5a00/0x5b377f42a7a7d7b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7d7ad expref: 18 pid: 18854 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748634.924801:0:20979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7271c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20979:1875638377118336:0@lo:104: 00000100:00100000:0.0:1788748634.924823:0:20979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788748634.924856:0:20979:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ceed6f9400/0x5b377f42a7a7d767 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b377f42a7a7d760 expref: 18 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748634.924873:0:20979:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ceed6f9400/0x5b377f42a7a7d767 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b377f42a7a7d760 expref: 18 pid: 18856 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748634.924881:0:20979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7273480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20979:1875638377118464:0@lo:104: 00000100:00100000:0.0:1788748634.924904:0:20979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748634.924914:0:20979:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cec655d240 going to sleep for 11 seconds 00000100:00100000:3.0:1788748634.925058:0:18845:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788748634.925071:0:18845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377118208 00000100:00100000:3.0:1788748634.925078:0:18845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377118208 00000100:00100000:3.0:1788748634.925115:0:18845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377118336 00000100:00100000:3.0:1788748634.925117:0:18845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377118336 00000100:00100000:3.0:1788748634.925127:0:18845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377118464 00000100:00100000:3.0:1788748634.925129:0:18845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377118464 00000100:00100000:3.0:1788748634.925141:0:18845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788748634.925149:0:18845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ddbae60-91f9-474f-9a47-689ab5e32951+5:20979:x1875638377118208:12345-0@lo:104: 00010000:00010000:3.0:1788748634.925160:0:18845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99cef6bdee00/0x5b377f42a7a7d81d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7d824 expref: -99 pid: 20265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748634.925218:0:18845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788748634.925224:0:18845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ddbae60-91f9-474f-9a47-689ab5e32951+5:20979:x1875638377118208:12345-0@lo:104: Request processed in 76us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748634.925231:0:18845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788748634.925247:0:18845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788748634.925253:0:18845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7270700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ddbae60-91f9-474f-9a47-689ab5e32951+4:20979:x1875638377118336:12345-0@lo:104: 00010000:00010000:3.0:1788748634.925261:0:18845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7d7ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7d7b4 expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748634.925294:0:18845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788748634.925299:0:18845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7270700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ddbae60-91f9-474f-9a47-689ab5e32951+4:20979:x1875638377118336:12345-0@lo:104: Request processed in 47us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748634.925315:0:18845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788748634.925327:0:18845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788748634.925333:0:18845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc7528050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ddbae60-91f9-474f-9a47-689ab5e32951+3:20979:x1875638377118464:12345-0@lo:104: 00010000:00010000:3.0:1788748634.925340:0:18845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff99ced13e4000/0x5b377f42a7a7d760 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7d767 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748634.925374:0:18845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788748634.925379:0:18845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc7528050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ddbae60-91f9-474f-9a47-689ab5e32951+3:20979:x1875638377118464:12345-0@lo:104: Request processed in 47us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748634.925384:0:18845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788748634.925432:0:20345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788748634.925438:0:20345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99cef6bdee00/0x5b377f42a7a7d81d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7d824 expref: -99 pid: 20265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748634.925445:0:20345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cef6bdee00 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:3.0:1788748634.925449:0:20345:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99cef6bdee00/0x5b377f42a7a7d81d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7d824 expref: -99 pid: 20265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748634.925458:0:20345:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99cef6bdee00/0x5b377f42a7a7d81d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7d824 expref: -99 pid: 20265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788748634.925466:0:20345:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99cef6bdee00/0x5b377f42a7a7d81d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7d824 expref: -99 pid: 20265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748634.925472:0:20345:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788748634.925500:0:20345:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99cef6bdee00/0x5b377f42a7a7d81d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d824 expref: -99 pid: 20265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748634.925506:0:20345:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788748634.925533:0:20345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99cef6bdee00/0x5b377f42a7a7d81d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d824 expref: -99 pid: 20265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748634.925541:0:20345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99cef6bdee00/0x5b377f42a7a7d81d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d824 expref: -99 pid: 20265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748634.925554:0:20345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788748634.925557:0:20345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7d7ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7d7b4 expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748634.925562:0:20345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e5e00 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:3.0:1788748634.925564:0:20345:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7d7ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7d7b4 expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748634.925570:0:20345:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7d7ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7d7b4 expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788748634.925576:0:20345:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7d7ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7d7b4 expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748634.925581:0:20345:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788748634.925594:0:20345:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7d7ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d7b4 expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748634.925599:0:20345:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788748634.925613:0:20345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7d7ad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d7b4 expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748634.925619:0:20345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99ced13e5e00/0x5b377f42a7a7d7ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d7b4 expref: -99 pid: 19545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748634.925638:0:20345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748634.925641:0:20345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff99ced13e4000/0x5b377f42a7a7d760 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b377f42a7a7d767 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748634.925646:0:20345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e4000 already unused, calling callback (ffffffffc1d1ec20) 10000000:00010000:3.0:1788748634.925649:0:20345:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff99ced13e4000/0x5b377f42a7a7d760 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b377f42a7a7d767 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748634.925656:0:20345:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff99ced13e4000/0x5b377f42a7a7d760 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b377f42a7a7d767 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788748634.925662:0:20345:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff99ced13e4000/0x5b377f42a7a7d760 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b377f42a7a7d767 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748634.925667:0:20345:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788748634.925680:0:20345:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff99ced13e4000/0x5b377f42a7a7d760 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d767 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748634.925686:0:20345:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788748634.925692:0:20345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff99ced13e4000/0x5b377f42a7a7d760 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d767 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748634.925699:0:20345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff99ced13e4000/0x5b377f42a7a7d760 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b377f42a7a7d767 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748634.925711:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748634.925713:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748634.925715:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748634.925722:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748634.925733:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748634.925750:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ddbae60-91f9-474f-9a47-689ab5e32951:3307:1875638377118592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788748634.925779:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748634.925820:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb633800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ddbae60-91f9-474f-9a47-689ab5e32951:3308:1875638377118720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788748634.925842:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748634.925860:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788748634.925987:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ddbae60-91f9-474f-9a47-689ab5e32951:3308:1875638377118848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788748634.926074:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748634.926222:0:20979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20979:1875638377118208:0@lo:104: 00000100:00100000:0.0:1788748634.926232:0:20979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7271c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20979:1875638377118336:0@lo:104: 00000100:00100000:0.0:1788748634.926239:0:20979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7273480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20979:1875638377118464:0@lo:104: 00000100:00100000:1.0:1788748634.929238:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377118592 00000100:00100000:1.0:1788748634.929253:0:18847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377118592 00010000:00010000:1.0:1788748634.929301:0:18847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cef6bde800/0x5b377f42a7a7d824 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7d81d expref: 19 pid: 18857 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748634.929326:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377118720 00000100:00100000:1.0:1788748634.929329:0:18847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377118720 00010000:00010000:1.0:1788748634.929341:0:18847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ced13e5a00/0x5b377f42a7a7d7b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7d7ad expref: 20 pid: 18854 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748634.929351:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377118848 00000100:00100000:1.0:1788748634.929353:0:18847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377118848 00010000:00010000:1.0:1788748634.929364:0:18847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ceed6f9400/0x5b377f42a7a7d767 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7d760 expref: 21 pid: 18856 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748634.929378:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788748634.929386:0:18847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb632300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ddbae60-91f9-474f-9a47-689ab5e32951+21:3307:x1875638377118592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788748634.929409:0:18847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748634.929414:0:18847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cef6bde800/0x5b377f42a7a7d824 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7d81d expref: 21 pid: 18857 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748634.929424:0:18847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cef6bde800/0x5b377f42a7a7d824 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7d81d expref: 21 pid: 18857 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748634.929454:0:18847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cef6bde800/0x5b377f42a7a7d824 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7d81d expref: 21 pid: 18857 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748634.929471:0:18847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748634.929547:0:18847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb632300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ddbae60-91f9-474f-9a47-689ab5e32951+20:3307:x1875638377118592:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (3769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748634.929554:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788748634.929570:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788748634.929576:0:18847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb633480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ddbae60-91f9-474f-9a47-689ab5e32951+19:3308:x1875638377118720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788748634.929584:0:18847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748634.929588:0:18847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ced13e5a00/0x5b377f42a7a7d7b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7d7ad expref: 19 pid: 18854 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748634.929595:0:18847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ced13e5a00/0x5b377f42a7a7d7b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7d7ad expref: 19 pid: 18854 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748634.929605:0:18847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced13e5a00/0x5b377f42a7a7d7b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7d7ad expref: 19 pid: 18854 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748634.929614:0:18847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748634.929652:0:18847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb633480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ddbae60-91f9-474f-9a47-689ab5e32951+18:3308:x1875638377118720:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (3809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748634.929658:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788748634.929670:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788748634.929675:0:18847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5074850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ddbae60-91f9-474f-9a47-689ab5e32951+17:3308:x1875638377118848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788748634.929683:0:18847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748634.929687:0:18847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ceed6f9400/0x5b377f42a7a7d767 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b377f42a7a7d760 expref: 17 pid: 18856 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748634.929700:0:18847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ceed6f9400/0x5b377f42a7a7d767 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b377f42a7a7d760 expref: 17 pid: 18856 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748634.929710:0:18847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ceed6f9400/0x5b377f42a7a7d767 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b377f42a7a7d760 expref: 17 pid: 18856 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748634.929719:0:18847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748634.929743:0:18847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5074850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ddbae60-91f9-474f-9a47-689ab5e32951+16:3308:x1875638377118848:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (3669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748634.929749:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788748634.931010:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ddbae60-91f9-474f-9a47-689ab5e32951:3308:1875638377118848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788748634.931052:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb633800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ddbae60-91f9-474f-9a47-689ab5e32951:3308:1875638377118720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788748634.931677:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ddbae60-91f9-474f-9a47-689ab5e32951:3307:1875638377118592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788748634.932740:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748634.932812:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358254592 00000100:00100000:1.0:1788748634.932819:0:18847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358254592 00010000:00010000:1.0:1788748634.932854:0:18847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ceecec2400/0x5b377f42a7a7da7e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c22 expref: 13 pid: 18856 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748634.932892:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:1.0:1788748634.932901:0:18847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7273b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:745dd5eb-2b80-4752-9076-ef21465f0c36+13:2347:x1875638358254592:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748634.932915:0:18847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748634.932920:0:18847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ceecec2400/0x5b377f42a7a7da7e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c22 expref: 13 pid: 18856 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748634.932931:0:18847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ceecec2400/0x5b377f42a7a7da7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c22 expref: 13 pid: 18856 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748634.932950:0:18847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748634.933002:0:18847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7273b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:745dd5eb-2b80-4752-9076-ef21465f0c36+13:2347:x1875638358254592:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 101us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748634.933009:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00010000:00010000:2.0:1788748634.934462:0:20979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ceecec2400/0x5b377f42a7a7da7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c22 expref: 12 pid: 18856 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748634.934479:0:20979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76aad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20979:1875638377117952:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788748634.934492:0:20979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76a9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20979:1875638377118080:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788748634.934527:0:20979:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99cec0031a00/0x5b377f42a7a7daa8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748634.935513:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748634.935602:0:18848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358254720 00000100:00100000:3.0:1788748634.935609:0:18848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358254720 00010000:00010000:3.0:1788748634.935639:0:18848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ced13e4600/0x5b377f42a7a7da46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521bc0 expref: 12 pid: 18857 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748634.935673:0:18848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:3.0:1788748634.935681:0:18848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7306300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:745dd5eb-2b80-4752-9076-ef21465f0c36+12:2348:x1875638358254720:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748634.935696:0:18848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748634.935702:0:18848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ced13e4600/0x5b377f42a7a7da46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521bc0 expref: 12 pid: 18857 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748634.935712:0:18848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ced13e4600/0x5b377f42a7a7da46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521bc0 expref: 12 pid: 18857 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748634.935728:0:18848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ced13e4600/0x5b377f42a7a7da46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521bc0 expref: 12 pid: 18857 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748634.935742:0:18848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99cec0031a00/0x5b377f42a7a7daa8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748634.935750:0:18848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cec0031a00/0x5b377f42a7a7daa8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748634.935773:0:18848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cec0031a00/0x5b377f42a7a7daa8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748634.935779:0:18848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cec0031a00/0x5b377f42a7a7daa8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748634.935796:0:18848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99cec0031a00/0x5b377f42a7a7daa8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748634.935804:0:18848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99cec0031a00/0x5b377f42a7a7daa8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748634.935810:0:18848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec0031a00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748634.935814:0:18848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99cec0031a00/0x5b377f42a7a7daa8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748634.935822:0:18848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99cec0031a00/0x5b377f42a7a7daa8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748634.935842:0:18848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99cec0031a00/0x5b377f42a7a7daa8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748634.935856:0:18848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748634.935906:0:18848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7306300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:745dd5eb-2b80-4752-9076-ef21465f0c36+11:2348:x1875638358254720:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 224us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748634.935913:0:18848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00010000:00010000:2.0:1788748634.936550:0:20979:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99cec0031a00/0x5b377f42a7a7daa8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748634.936560:0:20979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99cec0031a00/0x5b377f42a7a7daa8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748634.936566:0:20979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cec0031a00/0x5b377f42a7a7daa8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748635.245348:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788748635.565664:0:18897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788748636.124148:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748636.124331:0:18863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358254848 00000100:00100000:1.0:1788748636.124344:0:18863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358254848 00000100:00100000:1.0:1788748636.124444:0:18863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:1.0:1788748636.124457:0:18863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4430730-ba8d-423d-b041-116ce5a3d089+6:17318:x1875638358254848:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788748636.124484:0:18863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748636.124511:0:18863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7daaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521c53 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.124592:0:18863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7dab6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.124609:0:18863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7dab6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.124625:0:18863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7dab6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.124641:0:18863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7dabd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.124648:0:18863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7dabd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.124655:0:18863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7dabd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788748636.125069:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788748636.126229:0:18863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7dac4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.126255:0:18863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7dac4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.126293:0:18863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7dac4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748636.126340:0:18863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788748636.126345:0:18863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788748636.126402:0:18863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7dac4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.126417:0:18863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7dab6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.126424:0:18863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7dab6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.126431:0:18863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7dab6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.126437:0:18863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8800 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748636.126442:0:18863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7dab6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.126449:0:18863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7dab6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.126462:0:18863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646f00) 00010000:00010000:1.0:1788748636.126466:0:18863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748636.126472:0:18863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7dab6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.126478:0:18863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7dab6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.126505:0:18863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7dabd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.126512:0:18863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7dabd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.126518:0:18863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7dabd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.126523:0:18863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8a00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748636.126526:0:18863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7dabd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.126532:0:18863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7dabd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.126540:0:18863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff99cece6d7000) 00010000:00010000:1.0:1788748636.126543:0:18863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748636.126546:0:18863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7dabd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.126552:0:18863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7dabd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.126603:0:18863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7daaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c53 expref: 8 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.126619:0:18863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8200/0x5b377f42a7a7dac4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c53 expref: 7 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.126639:0:18863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99cece6d7f00) 00010000:00010000:1.0:1788748636.126641:0:18863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788748636.126644:0:18863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f8200, rc 0) 00000100:00100000:1.0:1788748636.126737:0:18863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4430730-ba8d-423d-b041-116ce5a3d089+7:17318:x1875638358254848:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 2281us (2600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748636.126747:0:18863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:0.0:1788748636.130816:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748636.130959:0:18862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358255104 00000100:00100000:3.0:1788748636.130976:0:18862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358255104 00000100:00100000:3.0:1788748636.131119:0:18862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:3.0:1788748636.131130:0:18862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4430730-ba8d-423d-b041-116ce5a3d089+7:17318:x1875638358255104:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788748636.131157:0:18862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748636.131189:0:18862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7dacb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521c5a expref: -99 pid: 18862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.131509:0:18862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7dad2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.131527:0:18862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7dad2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.131540:0:18862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7dad2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.131558:0:18862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7dad9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.131565:0:18862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7dad9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.131572:0:18862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7dad9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.132133:0:18862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7dae0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.132149:0:18862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7dae0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.132157:0:18862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7dae0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748636.132183:0:18862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788748636.135638:0:18862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7dad2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.135660:0:18862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7dad2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.135670:0:18862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7dad2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.135677:0:18862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2c00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748636.135682:0:18862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7dad2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.135690:0:18862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7dad2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.135711:0:18862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99cece6d7f00) 00010000:00010000:3.0:1788748636.135715:0:18862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748636.135720:0:18862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7dad2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.135726:0:18862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2c00/0x5b377f42a7a7dad2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.135744:0:18862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7dad9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.135751:0:18862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7dad9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.136709:0:18862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7dad9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.136724:0:18862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3000 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748636.136727:0:18862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7dad9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.136736:0:18862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7dad9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.136751:0:18862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99cec6646200) 00010000:00010000:3.0:1788748636.136754:0:18862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748636.136757:0:18862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7dad9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.136764:0:18862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3000/0x5b377f42a7a7dad9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.137508:0:18862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2800/0x5b377f42a7a7dacb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c5a expref: 10 pid: 18862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.137532:0:18862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3a00/0x5b377f42a7a7dae0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c5a expref: 9 pid: 18862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.137541:0:18862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cec6646600) 00010000:00010000:3.0:1788748636.137545:0:18862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748636.137548:0:18862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec3a00, rc 0) 00000100:00100000:3.0:1788748636.137641:0:18862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4430730-ba8d-423d-b041-116ce5a3d089+9:17318:x1875638358255104:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 6511us (6837us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788748636.137662:0:18862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:2.0:1788748636.148450:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748636.152715:0:18864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358255232 00000100:00100000:3.0:1788748636.152737:0:18864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358255232 00000100:00100000:3.0:1788748636.152847:0:18864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:3.0:1788748636.153320:0:18864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4430730-ba8d-423d-b041-116ce5a3d089+9:17318:x1875638358255232:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788748636.153480:0:18864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4430730-ba8d-423d-b041-116ce5a3d089+9:17318:x1875638358255232:12345-192.168.203.4@tcp:59:lhsmtool_posix.0 Request processed in 622us (5044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748636.153492:0:18864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:1.0:1788748636.216744:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748636.218011:0:19570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358255360 00000100:00100000:0.0:1788748636.218044:0:19570:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358255360 00000100:00100000:0.0:1788748636.218213:0:19570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:0.0:1788748636.218226:0:19570:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4430730-ba8d-423d-b041-116ce5a3d089+9:17324:x1875638358255360:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788748636.218274:0:19570:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748636.218303:0:19570:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031400/0x5b377f42a7a7daee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521c61 expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.218401:0:19570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031600/0x5b377f42a7a7daf5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.218419:0:19570:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031600/0x5b377f42a7a7daf5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.218436:0:19570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031600/0x5b377f42a7a7daf5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.218453:0:19570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030600/0x5b377f42a7a7dafc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.218460:0:19570:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030600/0x5b377f42a7a7dafc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.218466:0:19570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030600/0x5b377f42a7a7dafc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.218742:0:19570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031600/0x5b377f42a7a7daf5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.218750:0:19570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031600/0x5b377f42a7a7daf5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.218757:0:19570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031600/0x5b377f42a7a7daf5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.218763:0:19570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec0031600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748636.218774:0:19570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031600/0x5b377f42a7a7daf5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.221969:0:19570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031600/0x5b377f42a7a7daf5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.221997:0:19570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646f00) 00010000:00010000:0.0:1788748636.222000:0:19570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748636.222008:0:19570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031600/0x5b377f42a7a7daf5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.222031:0:19570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031600/0x5b377f42a7a7daf5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.222059:0:19570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030600/0x5b377f42a7a7dafc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.222067:0:19570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030600/0x5b377f42a7a7dafc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.222075:0:19570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030600/0x5b377f42a7a7dafc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.222081:0:19570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec0030600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748636.222084:0:19570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030600/0x5b377f42a7a7dafc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.222090:0:19570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030600/0x5b377f42a7a7dafc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.222098:0:19570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff99cec3e09200) 00010000:00010000:0.0:1788748636.222101:0:19570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748636.222127:0:19570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030600/0x5b377f42a7a7dafc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.222134:0:19570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030600/0x5b377f42a7a7dafc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.222202:0:19570:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031400/0x5b377f42a7a7daee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c61 expref: 10 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.222214:0:19570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646f00) 00010000:00010000:0.0:1788748636.222216:0:19570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748636.222220:0:19570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031400/0x5b377f42a7a7daee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c61 expref: 10 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.222231:0:19570:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec0031400, rc 0) 00000100:00100000:0.0:1788748636.222341:0:19570:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4430730-ba8d-423d-b041-116ce5a3d089+9:17324:x1875638358255360:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 4116us (5608us total) trans 0 rc 301/301 00000100:00100000:0.0:1788748636.222352:0:19570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:0.0:1788748636.233076:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748636.233508:0:18871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358255488 00000100:00100000:3.0:1788748636.233523:0:18871:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358255488 00000100:00100000:3.0:1788748636.233662:0:18871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:3.0:1788748636.233676:0:18871:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d4430730-ba8d-423d-b041-116ce5a3d089+9:17324:x1875638358255488:12345-192.168.203.4@tcp:700:lfs.0 00000100:00100000:3.0:1788748636.233809:0:18871:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d4430730-ba8d-423d-b041-116ce5a3d089+9:17324:x1875638358255488:12345-192.168.203.4@tcp:700:lfs.0 Request processed in 135us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748636.233816:0:18871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:2.0:1788748636.239454:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748636.239584:0:18863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358255744 00000100:00100000:1.0:1788748636.239598:0:18863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358255744 00000100:00100000:1.0:1788748636.239974:0:18863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:1.0:1788748636.239991:0:18863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4430730-ba8d-423d-b041-116ce5a3d089+9:17324:x1875638358255744:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:1.0:1788748636.240108:0:18863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748636.240143:0:18863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7da69 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521bea expref: 9 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.240179:0:18863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646f00) 00010000:00010000:1.0:1788748636.240185:0:18863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788748636.240487:0:18863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7db03 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.240506:0:18863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7daa1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c4c expref: 5 pid: 18864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.240517:0:18863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7db03 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.240562:0:18863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7daa1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c4c expref: 5 pid: 18864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.240591:0:18863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7daa1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c4c expref: 5 pid: 18864 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748636.240609:0:18863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef76ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18863:1875638377118976:192.168.203.4@tcp:104: 00000100:00100000:1.0:1788748636.240756:0:18863:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed7319c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748636.256908:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748636.256984:0:18863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef76ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18863:1875638377118976:192.168.203.4@tcp:104: 00010000:00010000:1.0:1788748636.257053:0:18863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7db03 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748636.257129:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358255872 00000100:00100000:2.0:1788748636.257138:0:18849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358255872 00010000:00010000:2.0:1788748636.257214:0:18849:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7daa1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c4c expref: 6 pid: 18864 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748636.257256:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:2.0:1788748636.257268:0:18849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7270a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd074acc-e2d0-4043-bc1b-1aea376ea903+6:2348:x1875638358255872:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748636.257287:0:18849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748636.257295:0:18849:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7daa1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c4c expref: 6 pid: 18864 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748636.257309:0:18849:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7daa1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c4c expref: 6 pid: 18864 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748636.257339:0:18849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7daa1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c4c expref: 6 pid: 18864 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748636.257376:0:18849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646f00) 00010000:00010000:2.0:1788748636.257392:0:18849:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7db03 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748636.257404:0:18849:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7db03 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748636.257413:0:18849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7db03 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748636.257446:0:18849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748636.257518:0:18849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7270a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd074acc-e2d0-4043-bc1b-1aea376ea903+5:2348:x1875638358255872:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 251us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748636.257527:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00080000:0.0:1788748636.257593:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788748636.257643:0:18863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7db03 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.257652:0:18863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7db03 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.257681:0:18863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7db0a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.257691:0:18863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7db0a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.257700:0:18863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7db0a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748636.259146:0:18863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788748636.259168:0:18863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7db03 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.259178:0:18863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7db03 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.259197:0:18863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7db03 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.259203:0:18863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8a00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748636.259208:0:18863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7db03 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.259216:0:18863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7db03 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.259233:0:18863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cec6646f00) 00010000:00010000:1.0:1788748636.259237:0:18863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748636.259242:0:18863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7db03 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.259249:0:18863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7db03 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788748636.259274:0:18863:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000cb572744 reply state 00000000eaab445e transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7db0a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748636.259284:0:18863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788748636.259415:0:18863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4430730-ba8d-423d-b041-116ce5a3d089+10:17324:x1875638358255744:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 19425us (19972us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788748636.259424:0:18863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00010000:00010000:3.0:1788748636.261262:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7db0a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.261283:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7db0a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.261291:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7db0a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.261297:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8800 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748636.261302:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7db0a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.261320:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7db0a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.261337:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff99cece6d7000) 00010000:00010000:3.0:1788748636.261341:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748636.261346:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7db0a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.261353:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8800/0x5b377f42a7a7db0a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.269880:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788748636.333170:0:18859:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788748636.333182:0:18859:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99cee516f800 from 10 10000000:01000000:3.0:1788748636.333190:0:18859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788748636.333261:0:18859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceecec2800/0x5b377f42a7a7db11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.333275:0:18859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ceecec2800/0x5b377f42a7a7db11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.333287:0:18859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ceecec2800/0x5b377f42a7a7db11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748636.333322:0:18859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377119104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788748636.333438:0:18859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748636.333505:0:18859:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cecdd37840 going to sleep for 11 seconds 00000100:00100000:0.0:1788748636.333554:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377119104 00000100:00100000:0.0:1788748636.333565:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377119104 00000100:00100000:0.0:1788748636.333630:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788748636.333641:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd839450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+16:18859:x1875638377119104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788748636.333658:0:18857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748636.333676:0:18857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cec0031600/0x5b377f42a7a7db18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7db11 expref: -99 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.333728:0:18857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cec0031600/0x5b377f42a7a7db18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7db11 expref: 17 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.333742:0:18857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cec0031600/0x5b377f42a7a7db18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7db11 expref: 17 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.333752:0:18857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec0031600, rc 0) 00000100:00100000:0.0:1788748636.333809:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd839450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+17:18859:x1875638377119104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748636.333817:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788748636.335081:0:18859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377119104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748636.335113:0:18859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ceecec2800/0x5b377f42a7a7db11 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7db18 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.335141:0:18859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ceecec2800/0x5b377f42a7a7db11 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7db18 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748636.335236:0:18859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377119232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748636.335291:0:18859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748636.335416:0:18859:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cecdd37840 going to sleep for 11 seconds 00000100:00100000:1.0:1788748636.339307:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377119232 00000100:00100000:1.0:1788748636.339329:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377119232 00000100:00100000:1.0:1788748636.339427:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788748636.339439:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd83b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+17:18859:x1875638377119232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748636.340040:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd83b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+17:18859:x1875638377119232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 572us (4717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748636.340050:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788748636.344204:0:18859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377119232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748636.344649:0:18859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377119360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748636.344757:0:18859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748636.344817:0:18859:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cecdd37840 going to sleep for 11 seconds 00000100:00100000:1.0:1788748636.347111:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377119360 00000100:00100000:1.0:1788748636.347132:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377119360 00000100:00100000:1.0:1788748636.347219:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788748636.347232:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd83b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+17:18859:x1875638377119360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748636.347578:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd83b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+17:18859:x1875638377119360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 347us (2819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748636.347588:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788748636.347800:0:18859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377119360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788748636.349219:0:20992:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000100:00100000:2.0:1788748636.349576:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748636.349691:0:18862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358256000 00000100:00100000:1.0:1788748636.349702:0:18862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358256000 00000100:00100000:1.0:1788748636.349760:0:18862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:1.0:1788748636.349770:0:18862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4430730-ba8d-423d-b041-116ce5a3d089+9:17333:x1875638358256000:12345-192.168.203.4@tcp:101:lctl.0 00010000:00010000:1.0:1788748636.349799:0:18862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748636.349830:0:18862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7db1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521c68 expref: -99 pid: 18862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.349933:0:18862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7db26 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.349949:0:18862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7db26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.349963:0:18862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7db26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748636.350006:0:18862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788748636.350044:0:18862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788748636.350091:0:18862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7db26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.350118:0:18862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8a00/0x5b377f42a7a7db1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c68 expref: 11 pid: 18862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.350135:0:18862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9e00/0x5b377f42a7a7db26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c68 expref: 10 pid: 18862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.350144:0:18862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cece6d7500) 00010000:00010000:1.0:1788748636.350147:0:18862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788748636.350151:0:18862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f9e00, rc 0) 00000100:00100000:1.0:1788748636.350214:0:18862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4430730-ba8d-423d-b041-116ce5a3d089+10:17333:x1875638358256000:12345-192.168.203.4@tcp:101:lctl.0 Request processed in 446us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748636.350220:0:18862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00000020:01000000:3.0:1788748636.350756:0:18859:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788748636.350795:0:18859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788748636.350807:0:18859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceecec2800/0x5b377f42a7a7db11 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7db18 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.350817:0:18859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ceecec2800/0x5b377f42a7a7db11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7db18 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748636.350829:0:18859:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788748636.350833:0:18859:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99cec6633000 from 10 10000000:01000000:3.0:1788748636.350836:0:18859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788748636.350998:0:18859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceecec3000/0x5b377f42a7a7db2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.351008:0:18859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ceecec3000/0x5b377f42a7a7db2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.351104:0:18859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ceecec3000/0x5b377f42a7a7db2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748636.351132:0:18859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377119488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788748636.351200:0:18859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748636.351250:0:18859:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cecdd37840 going to sleep for 11 seconds 00000100:00100000:1.0:1788748636.351356:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377119488 00000100:00100000:1.0:1788748636.351364:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377119488 00000100:00100000:1.0:1788748636.351510:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788748636.351521:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd839050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+17:18859:x1875638377119488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748636.351534:0:18856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748636.351550:0:18856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ceed6f8800/0x5b377f42a7a7db34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7db2d expref: -99 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.351576:0:18856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ceed6f8800/0x5b377f42a7a7db34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7db2d expref: 18 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.351588:0:18856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ceed6f8800/0x5b377f42a7a7db34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7db2d expref: 18 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.351613:0:18856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f8800, rc 0) 00000100:00100000:1.0:1788748636.351661:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd839050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+18:18859:x1875638377119488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748636.351668:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788748636.351766:0:18859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377119488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748636.351783:0:18859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ceecec3000/0x5b377f42a7a7db2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7db34 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.351793:0:18859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ceecec3000/0x5b377f42a7a7db2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7db34 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748636.352234:0:18859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377119616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748636.352272:0:18859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748636.352305:0:18859:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cecdd37840 going to sleep for 11 seconds 00000100:00100000:0.0:1788748636.352405:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377119616 00000100:00100000:0.0:1788748636.352412:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377119616 00000100:00100000:0.0:1788748636.352453:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788748636.352463:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd83b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+18:18859:x1875638377119616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788748636.352786:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd83b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+18:18859:x1875638377119616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 324us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748636.352794:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788748636.353144:0:18859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377119616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748636.353197:0:18859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377119744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748636.353245:0:18859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748636.353319:0:18859:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cecdd37840 going to sleep for 11 seconds 00000100:00100000:1.0:1788748636.358184:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377119744 00000100:00100000:1.0:1788748636.358208:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377119744 00000100:00100000:1.0:1788748636.358327:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788748636.358339:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd838850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+18:18859:x1875638377119744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748636.358723:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd838850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+18:18859:x1875638377119744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 385us (5476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748636.358733:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788748636.367640:0:18859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377119744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788748636.368978:0:20993:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788748636.369441:0:18859:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788748636.369478:0:18859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788748636.369490:0:18859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceecec3000/0x5b377f42a7a7db2d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7db34 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.369523:0:18859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ceecec3000/0x5b377f42a7a7db2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7db34 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748636.369536:0:18859:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788748636.369539:0:18859:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99cdc6438000 from 10 10000000:01000000:3.0:1788748636.369542:0:18859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788748636.369601:0:18859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceecec2c00/0x5b377f42a7a7db3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.369619:0:18859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff99ceecec2c00/0x5b377f42a7a7db3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.369632:0:18859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff99ceecec2c00/0x5b377f42a7a7db3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748636.369664:0:18859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377119872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788748636.369751:0:18859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748636.369810:0:18859:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cecdd37840 going to sleep for 11 seconds 00000100:00100000:1.0:1788748636.370241:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377119872 00000100:00100000:1.0:1788748636.370252:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377119872 00000100:00100000:1.0:1788748636.370317:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788748636.370328:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd83a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+18:18859:x1875638377119872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748636.370346:0:18854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748636.370364:0:18854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ceed6f8a00/0x5b377f42a7a7db42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b377f42a7a7db3b expref: -99 pid: 18854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.370403:0:18854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ceed6f8a00/0x5b377f42a7a7db42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b377f42a7a7db3b expref: 19 pid: 18854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.370420:0:18854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ceed6f8a00/0x5b377f42a7a7db42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b377f42a7a7db3b expref: 19 pid: 18854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.370431:0:18854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f8a00, rc 0) 00000100:00100000:1.0:1788748636.370512:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd83a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+19:18859:x1875638377119872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748636.370519:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788748636.370630:0:18859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377119872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748636.370652:0:18859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff99ceecec2c00/0x5b377f42a7a7db3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7db42 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.370661:0:18859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff99ceecec2c00/0x5b377f42a7a7db3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b377f42a7a7db42 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748636.370742:0:18859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377120000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748636.370774:0:18859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748636.370813:0:18859:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cecdd37840 going to sleep for 11 seconds 00000100:00100000:0.0:1788748636.370873:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377120000 00000100:00100000:0.0:1788748636.370878:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377120000 00000100:00100000:0.0:1788748636.370916:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788748636.370923:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefd839850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+19:18859:x1875638377120000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788748636.371280:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefd839850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ddbae60-91f9-474f-9a47-689ab5e32951+19:18859:x1875638377120000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 356us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748636.371288:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788748636.371470:0:18859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377120000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748636.371506:0:18859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb631f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377120128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748636.371552:0:18859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748636.371585:0:18859:0:(client.c:2716:ptlrpc_set_wait()) set ffff99cecdd37840 going to sleep for 11 seconds 00000100:00100000:2.0:1788748636.371753:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377120128 00000100:00100000:2.0:1788748636.371760:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377120128 00000100:00100000:2.0:1788748636.375536:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788748636.375563:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecf9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+19:18859:x1875638377120128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788748636.375957:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecf9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ddbae60-91f9-474f-9a47-689ab5e32951+19:18859:x1875638377120128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 403us (4402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748636.375968:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788748636.376010:0:18859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb631f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ddbae60-91f9-474f-9a47-689ab5e32951:18859:1875638377120128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788748636.380356:0:20994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788748636.380597:0:18859:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788748636.380645:0:18859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788748636.380659:0:18859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff99ceecec2c00/0x5b377f42a7a7db3b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7db42 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.380674:0:18859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff99ceecec2c00/0x5b377f42a7a7db3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b377f42a7a7db42 expref: -99 pid: 18859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748636.382332:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748636.382903:0:18864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358256128 00000100:00100000:1.0:1788748636.382918:0:18864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358256128 00000100:00100000:1.0:1788748636.382992:0:18864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:1.0:1788748636.383004:0:18864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd074acc-e2d0-4043-bc1b-1aea376ea903+5:17334:x1875638358256128:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1788748636.383047:0:18864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748636.383073:0:18864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7db49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521c6f expref: -99 pid: 18864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.383156:0:18864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7db50 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.383173:0:18864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7db50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.383187:0:18864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7db50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748636.383233:0:18864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788748636.383237:0:18864:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788748636.383261:0:18864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7db50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.383288:0:18864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7db49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c6f expref: 7 pid: 18864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.383325:0:18864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9400/0x5b377f42a7a7db50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c6f expref: 6 pid: 18864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.383334:0:18864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cece6d7500) 00010000:00010000:1.0:1788748636.383338:0:18864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788748636.383342:0:18864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f9400, rc 0) 00000100:00100000:1.0:1788748636.383665:0:18864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd074acc-e2d0-4043-bc1b-1aea376ea903+6:17334:x1875638358256128:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 661us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748636.383674:0:18864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:1.0:1788748636.395121:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748636.395185:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748636.395311:0:18862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358256256 00000100:00100000:3.0:1788748636.395325:0:18862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358256256 00000100:00100000:3.0:1788748636.395411:0:18862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:3.0:1788748636.395423:0:18862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd074acc-e2d0-4043-bc1b-1aea376ea903+6:17334:x1875638358256256:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1788748636.395450:0:18862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748636.395478:0:18862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7db57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521c76 expref: -99 pid: 18862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.395572:0:18862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7db5e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.395589:0:18862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7db5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.395602:0:18862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7db5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.395643:0:18862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2400/0x5b377f42a7a7db65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.395652:0:18862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2400/0x5b377f42a7a7db65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.395885:0:18862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2400/0x5b377f42a7a7db65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.396002:0:18862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7db6c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.396011:0:18862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7db6c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.396139:0:18862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7db6c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748636.396181:0:18862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788748636.396187:0:18862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788748636.396214:0:18862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7db6c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.396229:0:18862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7db5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.396236:0:18862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7db5e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.396244:0:18862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7db5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748636.396357:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358256384 00000100:00100000:2.0:1788748636.396364:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358256384 00000100:00100000:2.0:1788748636.396423:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 114 00000100:00100000:2.0:1788748636.396433:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecf9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:745dd5eb-2b80-4752-9076-ef21465f0c36+11:16708:x1875638358256384:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788748636.396451:0:18854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748636.396464:0:18854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc8feb400/0x5b377f42a7a7db73 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521c7d expref: -99 pid: 18854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748636.396487:0:18854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc8feb400/0x5b377f42a7a7db73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c7d expref: 12 pid: 18854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748636.396498:0:18854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc8feb400/0x5b377f42a7a7db73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c7d expref: 12 pid: 18854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748636.396508:0:18854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc8feb400, rc 0) 00000100:00100000:2.0:1788748636.396966:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecf9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:745dd5eb-2b80-4752-9076-ef21465f0c36+12:16708:x1875638358256384:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 531us (1777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748636.396975:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 114 00010000:00010000:3.0:1788748636.397178:0:18862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec3e00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748636.397184:0:18862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7db5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.397195:0:18862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7db5e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.397215:0:18862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cece6d7500) 00010000:00010000:3.0:1788748636.397219:0:18862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748636.397226:0:18862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7db5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.397233:0:18862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7db5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.397251:0:18862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2400/0x5b377f42a7a7db65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.397732:0:18862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2400/0x5b377f42a7a7db65 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.397742:0:18862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2400/0x5b377f42a7a7db65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.397750:0:18862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2400 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:3.0:1788748636.397753:0:18862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2400/0x5b377f42a7a7db65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.397760:0:18862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2400/0x5b377f42a7a7db65 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.397788:0:18862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff99cec6646100) 00010000:00010000:3.0:1788748636.397790:0:18862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748636.397795:0:18862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2400/0x5b377f42a7a7db65 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.397801:0:18862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2400/0x5b377f42a7a7db65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.397856:0:18862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2a00/0x5b377f42a7a7db57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c76 expref: 8 pid: 18862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.397871:0:18862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7db6c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c76 expref: 7 pid: 18862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.397878:0:18862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99cec6646c00) 00010000:00010000:3.0:1788748636.397880:0:18862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788748636.397882:0:18862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec3c00, rc 0) 00000100:00100000:3.0:1788748636.397947:0:18862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd074acc-e2d0-4043-bc1b-1aea376ea903+7:17334:x1875638358256256:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 2526us (2841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748636.397958:0:18862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:2.0:1788748636.402627:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748636.404446:0:18863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358256640 00000100:00100000:0.0:1788748636.404468:0:18863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358256640 00000100:00100000:0.0:1788748636.404559:0:18863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:0.0:1788748636.404571:0:18863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb80b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd074acc-e2d0-4043-bc1b-1aea376ea903+7:17334:x1875638358256640:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:0.0:1788748636.404598:0:18863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748636.404626:0:18863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031000/0x5b377f42a7a7db7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521c84 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748636.404742:0:18863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788748636.405108:0:18863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031000/0x5b377f42a7a7db7a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c84 expref: 9 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.405125:0:18863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cece6d7500) 00010000:00010000:0.0:1788748636.405128:0:18863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788748636.405134:0:18863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031000/0x5b377f42a7a7db7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c84 expref: 9 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.405149:0:18863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec0031000, rc 0) 00000100:00100000:0.0:1788748636.405274:0:18863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb80b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd074acc-e2d0-4043-bc1b-1aea376ea903+8:17334:x1875638358256640:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 705us (2662us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1788748636.405283:0:18863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:2.0:1788748636.409552:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748636.409610:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748636.409656:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358256768 00000100:00100000:3.0:1788748636.409671:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358256768 00000100:00100000:3.0:1788748636.409742:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 115 00000100:00100000:3.0:1788748636.409754:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecf9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:745dd5eb-2b80-4752-9076-ef21465f0c36+12:16708:x1875638358256768:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748636.410429:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecf9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:745dd5eb-2b80-4752-9076-ef21465f0c36+12:16708:x1875638358256768:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 672us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748636.410442:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 115 00000100:00100000:0.0:1788748636.410533:0:19570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358257024 00000100:00100000:0.0:1788748636.410540:0:19570:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358257024 00000100:00100000:0.0:1788748636.410588:0:19570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:0.0:1788748636.410597:0:19570:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb80b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd074acc-e2d0-4043-bc1b-1aea376ea903+8:17334:x1875638358257024:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:0.0:1788748636.410653:0:19570:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748636.410687:0:19570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3c00/0x5b377f42a7a7db6c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c76 expref: 8 pid: 18862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.410715:0:19570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99cec6646c00) 00010000:00010000:0.0:1788748636.410729:0:19570:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788748636.410758:0:19570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7db88 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.410774:0:19570:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7db88 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.410786:0:19570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7db88 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748636.413317:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748636.413408:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358257152 00000100:00100000:1.0:1788748636.413422:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358257152 00000100:00100000:1.0:1788748636.413487:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 116 00000100:00100000:1.0:1788748636.414046:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecf9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:745dd5eb-2b80-4752-9076-ef21465f0c36+12:16708:x1875638358257152:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748636.414300:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecf9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:745dd5eb-2b80-4752-9076-ef21465f0c36+12:16708:x1875638358257152:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 738us (993us total) trans 0 rc 0/0 00000004:00010000:0.0:1788748636.418302:0:19570:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000001025bfeb reply state 00000000bf95a281 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7db88 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748636.418326:0:19570:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788748636.418343:0:19570:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788748636.422063:0:19570:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb80b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd074acc-e2d0-4043-bc1b-1aea376ea903+9:17334:x1875638358257024:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 11448us (12433us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1788748636.422077:0:19570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:1.0:1788748636.422480:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 116 00000100:00100000:2.0:1788748636.423202:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748636.423340:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358257280 00000100:00100000:3.0:1788748636.423354:0:18856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358257280 00000100:00100000:3.0:1788748636.423424:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 117 00000100:00100000:3.0:1788748636.423436:0:18856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecf9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:745dd5eb-2b80-4752-9076-ef21465f0c36+12:16708:x1875638358257280:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748636.423458:0:18856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748636.423479:0:18856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ceecec2a00/0x5b377f42a7a7db8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521c8b expref: -99 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.423513:0:18856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ceecec2a00/0x5b377f42a7a7db8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c8b expref: 13 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.423526:0:18856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ceecec2a00/0x5b377f42a7a7db8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c8b expref: 13 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.423534:0:18856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec2a00, rc 0) 00000100:00100000:3.0:1788748636.423802:0:18856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecf9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:745dd5eb-2b80-4752-9076-ef21465f0c36+13:16708:x1875638358257280:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 367us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748636.425247:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 117 00010000:00010000:1.0:1788748636.437423:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7db88 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.437444:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7db88 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.437455:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7db88 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.437478:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec0031200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748636.437484:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7db88 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.437492:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7db88 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.437513:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99cec3e09a00) 00010000:00010000:1.0:1788748636.437516:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788748636.437523:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7db88 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.437529:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7db88 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748636.439117:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748636.439166:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748636.439202:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358257664 00000100:00100000:3.0:1788748636.439215:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358257664 00000100:00100000:3.0:1788748636.439275:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 118 00000100:00100000:3.0:1788748636.439286:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecf9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:745dd5eb-2b80-4752-9076-ef21465f0c36+13:16708:x1875638358257664:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748636.440049:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecf9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:745dd5eb-2b80-4752-9076-ef21465f0c36+13:16708:x1875638358257664:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 758us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748636.440074:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 118 00000100:00100000:2.0:1788748636.440452:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358257536 00000100:00100000:2.0:1788748636.440461:0:18866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358257536 00000100:00100000:2.0:1788748636.440509:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:2.0:1788748636.440519:0:18866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd074acc-e2d0-4043-bc1b-1aea376ea903+8:17334:x1875638358257536:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1788748636.441168:0:18866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd074acc-e2d0-4043-bc1b-1aea376ea903+9:17334:x1875638358257536:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 646us (2060us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1788748636.441176:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:3.0:1788748636.443241:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748636.443329:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358257792 00000100:00100000:1.0:1788748636.443341:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358257792 00000100:00100000:1.0:1788748636.443447:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 119 00000100:00100000:1.0:1788748636.443458:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecf9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:745dd5eb-2b80-4752-9076-ef21465f0c36+13:16708:x1875638358257792:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748636.443757:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecf9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:745dd5eb-2b80-4752-9076-ef21465f0c36+13:16708:x1875638358257792:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 300us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748636.443765:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 119 00000100:00100000:2.0:1788748636.453135:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748636.453616:0:18863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358258048 00000100:00100000:1.0:1788748636.453630:0:18863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358258048 00000100:00100000:1.0:1788748636.453706:0:18863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:1.0:1788748636.453718:0:18863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb80aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd074acc-e2d0-4043-bc1b-1aea376ea903+9:17334:x1875638358258048:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1788748636.453749:0:18863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748636.453796:0:18863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7db96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521c92 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.453895:0:18863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7db9d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.453913:0:18863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7db9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.453927:0:18863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7db9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.453946:0:18863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7dba4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.453953:0:18863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7dba4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.453962:0:18863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7dba4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748636.454650:0:18863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788748636.454769:0:18863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7db9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.454778:0:18863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7db9d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.454784:0:18863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7db9d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.454791:0:18863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748636.454797:0:18863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7db9d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.454812:0:18863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7db9d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.454828:0:18863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cece6d7500) 00010000:00010000:1.0:1788748636.454831:0:18863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748636.454837:0:18863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7db9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.454844:0:18863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7db9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.454860:0:18863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7dba4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.454866:0:18863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7dba4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.454872:0:18863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7dba4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.454877:0:18863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8e00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748636.454880:0:18863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7dba4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.454887:0:18863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7dba4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.454894:0:18863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff99cece6d7000) 00010000:00010000:1.0:1788748636.454896:0:18863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748636.454899:0:18863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7dba4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.454913:0:18863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7dba4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.454974:0:18863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7db96 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c92 expref: 11 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.454986:0:18863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cece6d7500) 00010000:00010000:1.0:1788748636.454989:0:18863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788748636.454994:0:18863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7db96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c92 expref: 11 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.455008:0:18863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f8600, rc 0) 00000100:00100000:1.0:1788748636.455496:0:18863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb80aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd074acc-e2d0-4043-bc1b-1aea376ea903+10:17334:x1875638358258048:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1775us (2370us total) trans 12884901894 rc 301/301 00000100:00100000:1.0:1788748636.455508:0:18863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:0.0:1788748636.460325:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748636.460566:0:18864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358258176 00000100:00100000:2.0:1788748636.460721:0:18864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358258176 00000100:00100000:2.0:1788748636.460959:0:18864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:3.0:1788748636.462223:0:18864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd074acc-e2d0-4043-bc1b-1aea376ea903+10:17334:x1875638358258176:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:3.0:1788748636.463747:0:18864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748636.463798:0:18864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2400/0x5b377f42a7a7dbb2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521c99 expref: -99 pid: 18864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.464060:0:18864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7dbb9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.464079:0:18864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7dbb9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.464101:0:18864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7dbb9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748636.464140:0:18864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788748636.464144:0:18864:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788748636.464166:0:18864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7dbb9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.464204:0:18864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec2400/0x5b377f42a7a7dbb2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c99 expref: 12 pid: 18864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.464226:0:18864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7dbb9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c99 expref: 11 pid: 18864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748636.464235:0:18864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99cec6646400) 00010000:00010000:3.0:1788748636.464255:0:18864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788748636.469047:0:18864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceecec3e00, rc 0) 00000100:00100000:0.0:1788748636.469642:0:18864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd074acc-e2d0-4043-bc1b-1aea376ea903+11:17334:x1875638358258176:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 8663us (9323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748636.469655:0:18864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:1.0:1788748636.473910:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748636.474606:0:18865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358258304 00000100:00100000:3.0:1788748636.474621:0:18865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358258304 00000100:00100000:3.0:1788748636.474698:0:18865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:3.0:1788748636.474710:0:18865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd074acc-e2d0-4043-bc1b-1aea376ea903+11:17334:x1875638358258304:12345-192.168.203.4@tcp:37:lfs.0 00000100:00100000:3.0:1788748636.479561:0:18865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd074acc-e2d0-4043-bc1b-1aea376ea903+11:17334:x1875638358258304:12345-192.168.203.4@tcp:37:lfs.0 Request processed in 4837us (5648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748636.479579:0:18865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 3 00000001:00080000:3.0:1788748636.485190:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901890 is committed 00000100:00100000:3.0:1788748636.485717:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748636.485813:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358258560 00000100:00100000:2.0:1788748636.485826:0:18866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358258560 00000100:00100000:2.0:1788748636.485898:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:2.0:1788748636.485910:0:18866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01ddd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd074acc-e2d0-4043-bc1b-1aea376ea903+11:17334:x1875638358258560:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1788748636.486242:0:18866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01ddd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd074acc-e2d0-4043-bc1b-1aea376ea903+12:17334:x1875638358258560:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 332us (530us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788748636.486251:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:3.0:1788748636.552948:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748636.554005:0:18862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358258688 00000100:00100000:1.0:1788748636.554054:0:18862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358258688 00000100:00100000:1.0:1788748636.554203:0:18862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:1.0:1788748636.554217:0:18862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4430730-ba8d-423d-b041-116ce5a3d089+8:17342:x1875638358258688:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:1.0:1788748636.554244:0:18862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748636.554272:0:18862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7dbc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521ca0 expref: -99 pid: 18862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.554362:0:18862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7dbc7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.554416:0:18862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7dbc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.554431:0:18862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7dbc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.554451:0:18862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7dbce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.554459:0:18862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7dbce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.554467:0:18862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7dbce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.555269:0:18862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7dbd5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.555283:0:18862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7dbd5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.555292:0:18862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7dbd5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748636.555331:0:18862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788748636.555336:0:18862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788748636.555392:0:18862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7dbd5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.555407:0:18862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7dbc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.555423:0:18862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7dbc7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.555430:0:18862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7dbc7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.555436:0:18862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748636.555441:0:18862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7dbc7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.555449:0:18862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7dbc7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.555462:0:18862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cece6d7500) 00010000:00010000:1.0:1788748636.555466:0:18862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748636.555472:0:18862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7dbc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.555478:0:18862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7dbc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.555495:0:18862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7dbce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.555502:0:18862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7dbce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.555508:0:18862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7dbce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.555513:0:18862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748636.555522:0:18862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7dbce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.555529:0:18862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7dbce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.555537:0:18862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff99cece6d7000) 00010000:00010000:1.0:1788748636.555540:0:18862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748636.555543:0:18862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7dbce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.555549:0:18862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7dbce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.555966:0:18862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7dbc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ca0 expref: 10 pid: 18862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.555988:0:18862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4600/0x5b377f42a7a7dbd5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ca0 expref: 9 pid: 18862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.555997:0:18862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99cec6646400) 00010000:00010000:1.0:1788748636.555999:0:18862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788748636.556002:0:18862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e4600, rc 0) 00000100:00100000:1.0:1788748636.556198:0:18862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4430730-ba8d-423d-b041-116ce5a3d089+9:17342:x1875638358258688:12345-192.168.203.4@tcp:101:bash.0 Request processed in 1981us (3261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748636.556208:0:18862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:1.0:1788748636.559471:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748636.559572:0:19570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358258944 00000100:00100000:0.0:1788748636.559678:0:19570:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358258944 00000100:00100000:0.0:1788748636.559883:0:19570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:0.0:1788748636.559896:0:19570:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4430730-ba8d-423d-b041-116ce5a3d089+9:17342:x1875638358258944:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1788748636.559926:0:19570:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748636.559973:0:19570:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031000/0x5b377f42a7a7dbdc lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521ca7 expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.560338:0:19570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dbe3 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.560357:0:19570:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7dbb9 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c99 expref: 11 pid: 18864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.560367:0:19570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dbe3 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.560419:0:19570:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7dbb9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c99 expref: 11 pid: 18864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.560435:0:19570:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7dbb9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c99 expref: 11 pid: 18864 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748636.560451:0:19570:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7271500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19570:1875638377120256:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788748636.560572:0:19570:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced1bb5540 going to sleep for 11 seconds 00000100:00100000:3.0:1788748636.564277:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748636.564631:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358259072 00000100:00100000:2.0:1788748636.564644:0:18847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358259072 00010000:00010000:2.0:1788748636.564699:0:18847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7dbb9 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c99 expref: 12 pid: 18864 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748636.564954:0:19570:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7271500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19570:1875638377120256:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788748636.564989:0:19570:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dbe3 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748636.565183:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:2.0:1788748636.565197:0:18847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb633100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd074acc-e2d0-4043-bc1b-1aea376ea903+12:2347:x1875638358259072:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748636.565218:0:18847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748636.565226:0:18847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7dbb9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c99 expref: 12 pid: 18864 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748636.565242:0:18847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7dbb9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c99 expref: 12 pid: 18864 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748636.565268:0:18847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceecec3e00/0x5b377f42a7a7dbb9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521c99 expref: 12 pid: 18864 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748636.565286:0:18847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99cec6646400) 00010000:00010000:2.0:1788748636.565310:0:18847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dbe3 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748636.565321:0:18847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dbe3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748636.565331:0:18847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dbe3 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748636.565368:0:18847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748636.565451:0:18847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb633100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd074acc-e2d0-4043-bc1b-1aea376ea903+11:2347:x1875638358259072:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 258us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748636.565460:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00010000:00010000:0.0:1788748636.565864:0:19570:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dbe3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.565876:0:19570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dbe3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.566109:0:19570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030a00/0x5b377f42a7a7dbea lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.566123:0:19570:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030a00/0x5b377f42a7a7dbea lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.566134:0:19570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030a00/0x5b377f42a7a7dbea lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.568984:0:19570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031a00/0x5b377f42a7a7dbf1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.569044:0:19570:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031a00/0x5b377f42a7a7dbf1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.569060:0:19570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031a00/0x5b377f42a7a7dbf1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748636.569074:0:19570:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788748636.569106:0:19570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dbe3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.569113:0:19570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dbe3 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.569120:0:19570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dbe3 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.569127:0:19570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec0031200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748636.569132:0:19570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dbe3 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.569152:0:19570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dbe3 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.569167:0:19570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99cec6646400) 00010000:00010000:0.0:1788748636.569170:0:19570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748636.569176:0:19570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dbe3 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.569182:0:19570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dbe3 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788748636.569197:0:19570:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000d7936f18 reply state 000000007926d8d0 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030a00/0x5b377f42a7a7dbea lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748636.569207:0:19570:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788748636.569251:0:19570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031000/0x5b377f42a7a7dbdc lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ca7 expref: 12 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.569280:0:19570:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031a00/0x5b377f42a7a7dbf1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ca7 expref: 11 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.569288:0:19570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:0.0:1788748636.569291:0:19570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788748636.569293:0:19570:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec0031a00, rc 0) 00000100:00100000:0.0:1788748636.569402:0:19570:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4430730-ba8d-423d-b041-116ce5a3d089+12:17342:x1875638358258944:12345-192.168.203.4@tcp:101:bash.0 Request processed in 9509us (9945us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1788748636.569412:0:19570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 28 00010000:00010000:0.0:1788748636.570735:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030a00/0x5b377f42a7a7dbea lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.570766:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030a00/0x5b377f42a7a7dbea lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.570773:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030a00/0x5b377f42a7a7dbea lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.570780:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec0030a00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748636.570785:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030a00/0x5b377f42a7a7dbea lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.570792:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030a00/0x5b377f42a7a7dbea lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.570809:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff99cec3e09300) 00010000:00010000:0.0:1788748636.570812:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748636.570817:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030a00/0x5b377f42a7a7dbea lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.570824:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030a00/0x5b377f42a7a7dbea lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748636.580489:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748636.580588:0:18863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358259200 00000100:00100000:0.0:1788748636.580603:0:18863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358259200 00000100:00100000:0.0:1788748636.580680:0:18863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:0.0:1788748636.580691:0:18863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4430730-ba8d-423d-b041-116ce5a3d089+11:17342:x1875638358259200:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1788748636.580723:0:18863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748636.580749:0:18863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031000/0x5b377f42a7a7dbff lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521cae expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.580858:0:18863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dc06 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.580874:0:18863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dc06 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.580888:0:18863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dc06 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748636.580937:0:18863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788748636.580943:0:18863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788748636.580963:0:18863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dc06 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.580975:0:18863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dc06 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.581009:0:18863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031000/0x5b377f42a7a7dbff lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cae expref: 13 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.581062:0:18863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dc06 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cae expref: 12 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.581071:0:18863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:0.0:1788748636.581075:0:18863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788748636.581079:0:18863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec0031200, rc 0) 00000100:00100000:0.0:1788748636.581149:0:18863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4430730-ba8d-423d-b041-116ce5a3d089+12:17342:x1875638358259200:12345-192.168.203.4@tcp:101:bash.0 Request processed in 460us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748636.581156:0:18863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:3.0:1788748636.586889:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748636.587123:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358259456 00000100:00100000:2.0:1788748636.587136:0:18866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358259456 00000100:00100000:2.0:1788748636.587201:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:2.0:1788748636.587212:0:18866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4430730-ba8d-423d-b041-116ce5a3d089+12:17342:x1875638358259456:12345-192.168.203.4@tcp:35:bash.0 00000001:00080000:2.0:1788748636.587568:0:18866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901897 00000100:00100000:2.0:1788748636.587707:0:18866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4430730-ba8d-423d-b041-116ce5a3d089+14:17342:x1875638358259456:12345-192.168.203.4@tcp:35:bash.0 Request processed in 495us (833us total) trans 12884901898 rc 0/0 00000100:00100000:2.0:1788748636.587716:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00000020:00080000:2.0:1788748636.587722:0:18866:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1788748636.589647:0:18897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788748636.676521:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748636.676774:0:18864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358259712 00000100:00100000:2.0:1788748636.676787:0:18864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358259712 00000100:00100000:2.0:1788748636.676865:0:18864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:2.0:1788748636.676876:0:18864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4430730-ba8d-423d-b041-116ce5a3d089+14:17352:x1875638358259712:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:2.0:1788748636.677113:0:18864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748636.677143:0:18864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521cb5 expref: -99 pid: 18864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748636.677289:0:18864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788748636.677458:0:18864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc0d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cb5 expref: 16 pid: 18864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748636.677476:0:18864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cece6d7500) 00010000:00010000:2.0:1788748636.677479:0:18864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788748636.677484:0:18864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cb5 expref: 16 pid: 18864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748636.677500:0:18864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc8fea400, rc 0) 00000100:00100000:2.0:1788748636.677963:0:18864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4430730-ba8d-423d-b041-116ce5a3d089+15:17352:x1875638358259712:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 1086us (1455us total) trans 12884901899 rc 301/301 00000100:00100000:2.0:1788748636.677973:0:18864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:1.0:1788748636.686217:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748636.686339:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358259968 00000100:00100000:2.0:1788748636.686352:0:18866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358259968 00000100:00100000:2.0:1788748636.686435:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:2.0:1788748636.686448:0:18866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4430730-ba8d-423d-b041-116ce5a3d089+15:17352:x1875638358259968:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:2.0:1788748636.687575:0:18866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4430730-ba8d-423d-b041-116ce5a3d089+16:17352:x1875638358259968:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 1122us (1365us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1788748636.687602:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:3.0:1788748636.752526:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748636.753847:0:18862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358260224 00000100:00100000:1.0:1788748636.753890:0:18862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358260224 00000100:00100000:1.0:1788748636.754086:0:18862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:1.0:1788748636.754100:0:18862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4430730-ba8d-423d-b041-116ce5a3d089+16:17355:x1875638358260224:12345-192.168.203.4@tcp:101:lfs.0 00010000:00010000:1.0:1788748636.754134:0:18862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748636.754161:0:18862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5a00/0x5b377f42a7a7dc1b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521cbc expref: -99 pid: 18862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.754294:0:18862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5e00/0x5b377f42a7a7dc22 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.754310:0:18862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5e00/0x5b377f42a7a7dc22 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.754325:0:18862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5e00/0x5b377f42a7a7dc22 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748636.754339:0:18862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788748636.754516:0:18862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5a00/0x5b377f42a7a7dc1b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cbc expref: 19 pid: 18862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.754538:0:18862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5e00/0x5b377f42a7a7dc22 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cbc expref: 18 pid: 18862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.754557:0:18862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:1.0:1788748636.754560:0:18862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788748636.754564:0:18862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e5e00, rc 0) 00000100:00100000:1.0:1788748636.754661:0:18862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4430730-ba8d-423d-b041-116ce5a3d089+18:17355:x1875638358260224:12345-192.168.203.4@tcp:101:lfs.0 Request processed in 564us (2148us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1788748636.754669:0:18862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:0.0:1788748636.759215:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748636.759338:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748636.759716:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358260480 00000100:00100000:2.0:1788748636.759733:0:19570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358260352 00000100:00100000:1.0:1788748636.759733:0:18849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358260480 00000100:00100000:2.0:1788748636.759742:0:19570:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358260352 00000100:00100000:1.0:1788748636.759832:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:1.0:1788748636.759853:0:18849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7272680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4430730-ba8d-423d-b041-116ce5a3d089+19:2347:x1875638358260480:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748636.759874:0:18849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748636.759905:0:18849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5e00/0x5b377f42a7a7dc22 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cbc expref: 19 pid: 18862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748636.759928:0:18849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:1.0:1788748636.759934:0:18849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748636.760038:0:18849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7272680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4430730-ba8d-423d-b041-116ce5a3d089+18:2347:x1875638358260480:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 188us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748636.760047:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:2.0:1788748636.760062:0:19570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 32 00000100:00100000:2.0:1788748636.760074:0:19570:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4430730-ba8d-423d-b041-116ce5a3d089+17:17355:x1875638358260352:12345-192.168.203.4@tcp:54:lfs.0 00010000:00010000:2.0:1788748636.760168:0:19570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc30 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748636.760205:0:19570:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc30 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748636.760218:0:19570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc30 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748636.760252:0:19570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc30 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748636.760260:0:19570:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc30 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748636.760268:0:19570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc30 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748636.760275:0:19570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc8fea400 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748636.760280:0:19570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc30 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748636.760289:0:19570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc30 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748636.760298:0:19570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:2.0:1788748636.760301:0:19570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788748636.760305:0:19570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc30 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748636.760311:0:19570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc30 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748636.761059:0:19570:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4430730-ba8d-423d-b041-116ce5a3d089+17:17355:x1875638358260352:12345-192.168.203.4@tcp:54:lfs.0 Request processed in 979us (1849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748636.761079:0:19570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 32 00000100:00100000:3.0:1788748636.764006:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748636.764161:0:18865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358260736 00000100:00100000:1.0:1788748636.764174:0:18865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358260736 00000100:00100000:1.0:1788748636.764249:0:18865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:1.0:1788748636.764263:0:18865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4430730-ba8d-423d-b041-116ce5a3d089+17:17355:x1875638358260736:12345-192.168.203.4@tcp:35:lfs.0 00000100:00100000:1.0:1788748636.764599:0:18865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4430730-ba8d-423d-b041-116ce5a3d089+18:17355:x1875638358260736:12345-192.168.203.4@tcp:35:lfs.0 Request processed in 338us (605us total) trans 12884901902 rc 0/0 00000100:00100000:1.0:1788748636.764618:0:18865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:1.0:1788748636.977761:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748636.977898:0:18863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358260992 00000100:00100000:0.0:1788748636.977911:0:18863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358260992 00000100:00100000:0.0:1788748636.978054:0:18863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:0.0:1788748636.978066:0:18863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4430730-ba8d-423d-b041-116ce5a3d089+18:17386:x1875638358260992:12345-192.168.203.4@tcp:101:cat.0 00010000:00010000:0.0:1788748636.978097:0:18863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748636.978123:0:18863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030a00/0x5b377f42a7a7dc37 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521cc3 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.978257:0:18863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030600/0x5b377f42a7a7dc3e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.978274:0:18863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030600/0x5b377f42a7a7dc3e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.978288:0:18863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030600/0x5b377f42a7a7dc3e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748636.978302:0:18863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788748636.978640:0:18863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030a00/0x5b377f42a7a7dc37 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cc3 expref: 21 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.978666:0:18863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030600/0x5b377f42a7a7dc3e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cc3 expref: 20 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748636.978675:0:18863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:0.0:1788748636.978694:0:18863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788748636.978699:0:18863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec0030600, rc 0) 00000100:00100000:0.0:1788748636.978788:0:18863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4430730-ba8d-423d-b041-116ce5a3d089+20:17386:x1875638358260992:12345-192.168.203.4@tcp:101:cat.0 Request processed in 723us (1039us total) trans 12884901903 rc 0/0 00000100:00100000:0.0:1788748636.978795:0:18863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:2.0:1788748636.982497:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748636.982696:0:18865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358261248 00000100:00100000:1.0:1788748636.982708:0:18865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358261248 00000100:00100000:3.0:1788748636.982730:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748636.982783:0:18865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:1.0:1788748636.982795:0:18865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb809180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4430730-ba8d-423d-b041-116ce5a3d089+20:17386:x1875638358261248:12345-192.168.203.4@tcp:35:cat.0 00000100:00100000:1.0:1788748636.983270:0:18865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb809180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4430730-ba8d-423d-b041-116ce5a3d089+21:17386:x1875638358261248:12345-192.168.203.4@tcp:35:cat.0 Request processed in 476us (786us total) trans 12884901904 rc 0/0 00000100:00100000:1.0:1788748636.983298:0:18865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:2.0:1788748636.983969:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358261376 00000100:00100000:2.0:1788748636.983980:0:18847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358261376 00000100:00100000:2.0:1788748636.984052:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:2.0:1788748636.984062:0:18847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb630700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4430730-ba8d-423d-b041-116ce5a3d089+21:2348:x1875638358261376:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748636.984077:0:18847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748636.984109:0:18847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030600/0x5b377f42a7a7dc3e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cc3 expref: 21 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748636.984135:0:18847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:2.0:1788748636.984141:0:18847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748636.984193:0:18847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb630700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4430730-ba8d-423d-b041-116ce5a3d089+20:2348:x1875638358261376:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 133us (1462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748636.984200:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:3.0:1788748637.031150:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748637.031268:0:18864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358261632 00000100:00100000:0.0:1788748637.031282:0:18864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358261632 00000100:00100000:0.0:1788748637.031486:0:18864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:0.0:1788748637.031499:0:18864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4430730-ba8d-423d-b041-116ce5a3d089+20:17392:x1875638358261632:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:0.0:1788748637.031539:0:18864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748637.031566:0:18864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030a00/0x5b377f42a7a7dc4c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521cca expref: -99 pid: 18864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.033760:0:18864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031400/0x5b377f42a7a7dc53 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.033801:0:18864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031a00/0x5b377f42a7a7dbf1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ca7 expref: 21 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.033812:0:18864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dc06 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cae expref: 21 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.033820:0:18864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031400/0x5b377f42a7a7dc53 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.033976:0:18864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dc06 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cae expref: 21 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.033996:0:18864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dc06 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cae expref: 21 pid: 18863 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748637.034046:0:18864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7270e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18864:1875638377120384:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788748637.034199:0:18864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031a00/0x5b377f42a7a7dbf1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ca7 expref: 21 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.034209:0:18864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031a00/0x5b377f42a7a7dbf1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ca7 expref: 21 pid: 19570 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748637.034218:0:18864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7272300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18864:1875638377120512:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788748637.034247:0:18864:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced1bb5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788748637.045346:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748637.045478:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358261760 00000100:00100000:2.0:1788748637.045493:0:18849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358261760 00010000:00010000:2.0:1788748637.045548:0:18849:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dc06 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cae expref: 22 pid: 18863 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748637.045598:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:2.0:1788748637.045610:0:18849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5077450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4430730-ba8d-423d-b041-116ce5a3d089+22:2348:x1875638358261760:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748637.045630:0:18849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748637.045638:0:18849:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dc06 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cae expref: 22 pid: 18863 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.045677:0:18849:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dc06 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cae expref: 22 pid: 18863 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.045707:0:18849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:2.0:1788748637.045714:0:18849:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031400/0x5b377f42a7a7dc53 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.045725:0:18849:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031400/0x5b377f42a7a7dc53 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.045733:0:18849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748637.045804:0:18849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5077450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4430730-ba8d-423d-b041-116ce5a3d089+22:2348:x1875638358261760:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 195us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748637.045812:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:3.0:1788748637.046271:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748637.046360:0:18848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358261888 00000100:00100000:3.0:1788748637.046366:0:18848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358261888 00010000:00010000:3.0:1788748637.046402:0:18848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031a00/0x5b377f42a7a7dbf1 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ca7 expref: 22 pid: 19570 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748637.046423:0:18848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:3.0:1788748637.046431:0:18848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb633100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4430730-ba8d-423d-b041-116ce5a3d089+22:2349:x1875638358261888:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748637.046749:0:18848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748637.046767:0:18848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031a00/0x5b377f42a7a7dbf1 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ca7 expref: 22 pid: 19570 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748637.046789:0:18848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031a00/0x5b377f42a7a7dbf1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ca7 expref: 22 pid: 19570 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748637.046811:0:18848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:3.0:1788748637.046816:0:18848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031400/0x5b377f42a7a7dc53 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748637.046826:0:18848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031400/0x5b377f42a7a7dc53 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748637.046834:0:18848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031400/0x5b377f42a7a7dc53 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748637.046865:0:18848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748637.046907:0:18848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb633100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4430730-ba8d-423d-b041-116ce5a3d089+22:2349:x1875638358261888:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 476us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748637.046916:0:18848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12 00010000:00010000:0.0:1788748637.048091:0:18864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dc06 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cae expref: 21 pid: 18863 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748637.048119:0:18864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7270e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18864:1875638377120384:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788748637.048134:0:18864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031a00/0x5b377f42a7a7dbf1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ca7 expref: 20 pid: 19570 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748637.048143:0:18864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7272300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18864:1875638377120512:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788748637.048179:0:18864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031400/0x5b377f42a7a7dc53 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.048190:0:18864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031400/0x5b377f42a7a7dc53 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.048196:0:18864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031400/0x5b377f42a7a7dc53 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748637.048247:0:18864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788748637.048648:0:18864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030a00/0x5b377f42a7a7dc4c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cca expref: 21 pid: 18864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.048670:0:18864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031400/0x5b377f42a7a7dc53 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cca expref: 20 pid: 18864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.048680:0:18864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:0.0:1788748637.048683:0:18864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788748637.048687:0:18864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec0031400, rc 0) 00000100:00100000:0.0:1788748637.048837:0:18864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4430730-ba8d-423d-b041-116ce5a3d089+20:17392:x1875638358261632:12345-192.168.203.4@tcp:101:dd.0 Request processed in 17339us (17698us total) trans 12884901905 rc 0/0 00000100:00100000:0.0:1788748637.048856:0:18864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:1.0:1788748637.060575:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748637.060683:0:18862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358262144 00000100:00100000:3.0:1788748637.060699:0:18862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358262144 00000100:00100000:3.0:1788748637.060785:0:18862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:3.0:1788748637.060796:0:18862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4430730-ba8d-423d-b041-116ce5a3d089+20:17392:x1875638358262144:12345-192.168.203.4@tcp:36:dd.0 00010000:00010000:2.0:1788748637.061619:0:18862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc61 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.061645:0:18862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc61 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.061659:0:18862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc61 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788748637.061730:0:18862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901906 00000004:00010000:2.0:1788748637.061759:0:18862:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000041aeb1c4 reply state 0000000036d46cc8 transno 12884901907 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc61 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748637.061832:0:18862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788748637.062093:0:18862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4430730-ba8d-423d-b041-116ce5a3d089+23:17392:x1875638358262144:12345-192.168.203.4@tcp:36:dd.0 Request processed in 1295us (1527us total) trans 12884901907 rc 0/0 00000100:00100000:2.0:1788748637.062118:0:18862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 35 00000020:00080000:2.0:1788748637.062125:0:18862:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788748637.065268:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc61 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.065291:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc61 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.065300:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc61 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.065307:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc8fea400 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748637.065313:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc61 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.065322:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc61 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.065426:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:1.0:1788748637.065431:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788748637.065477:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:1.0:1788748637.065500:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc61 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.065508:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc61 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748637.065568:0:19570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358262272 00000100:00100000:2.0:1788748637.065582:0:19570:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358262272 00000100:00100000:2.0:1788748637.065650:0:19570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:2.0:1788748637.065662:0:19570:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4430730-ba8d-423d-b041-116ce5a3d089+22:17392:x1875638358262272:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:2.0:1788748637.065692:0:19570:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748637.065713:0:19570:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feba00/0x5b377f42a7a7dc68 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521cd1 expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.065794:0:19570:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feba00/0x5b377f42a7a7dc68 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cd1 expref: 23 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.065809:0:19570:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feba00/0x5b377f42a7a7dc68 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cd1 expref: 23 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.065827:0:19570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:2.0:1788748637.065830:0:19570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788748637.065833:0:19570:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc8feba00, rc 0) 00000100:00100000:2.0:1788748637.065910:0:19570:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4430730-ba8d-423d-b041-116ce5a3d089+23:17392:x1875638358262272:12345-192.168.203.4@tcp:101:dd.0 Request processed in 249us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748637.065917:0:19570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:0.0:1788748637.075597:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748637.075689:0:18848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358262528 00000100:00100000:3.0:1788748637.075703:0:18848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358262528 00000100:00100000:3.0:1788748637.075790:0:18848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:3.0:1788748637.075802:0:18848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7272300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4430730-ba8d-423d-b041-116ce5a3d089+23:17392:x1875638358262528:12345-192.168.203.4@tcp:103:dd.0 00010000:00010000:3.0:1788748637.075864:0:18848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748637.075899:0:18848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feba00/0x5b377f42a7a7dc68 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cd1 expref: 23 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748637.075922:0:18848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:3.0:1788748637.075928:0:18848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748637.076098:0:18848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7272300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4430730-ba8d-423d-b041-116ce5a3d089+22:17392:x1875638358262528:12345-192.168.203.4@tcp:103:dd.0 Request processed in 298us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748637.076107:0:18848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:3.0:1788748637.078421:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748637.078521:0:18863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358262656 00000100:00100000:0.0:1788748637.078534:0:18863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358262656 00000100:00100000:0.0:1788748637.078609:0:18863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00100000:0.0:1788748637.078620:0:18863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4430730-ba8d-423d-b041-116ce5a3d089+22:17392:x1875638358262656:12345-192.168.203.4@tcp:58:dd.0 00010000:00010000:0.0:1788748637.078835:0:18863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031a00/0x5b377f42a7a7dc6f lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.078926:0:18863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031a00/0x5b377f42a7a7dc6f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.078943:0:18863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031a00/0x5b377f42a7a7dc6f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788748637.080438:0:18863:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788748637.080630:0:18863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1788748637.080717:0:18863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1788748637.081114:0:18863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4430730-ba8d-423d-b041-116ce5a3d089+22:17392:x1875638358262656:12345-192.168.203.4@tcp:58:dd.0 Request processed in 2488us (2700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748637.081128:0:18863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00100000:3.0:1788748637.083245:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748637.083541:0:19570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358262784 00000100:00100000:2.0:1788748637.083554:0:19570:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358262784 00000100:00100000:2.0:1788748637.083757:0:19570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:2.0:1788748637.083771:0:19570:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4430730-ba8d-423d-b041-116ce5a3d089+22:17392:x1875638358262784:12345-192.168.203.4@tcp:101:dd.0 00010000:00010000:2.0:1788748637.083818:0:19570:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748637.083848:0:19570:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feba00/0x5b377f42a7a7dc76 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521cd8 expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.083929:0:19570:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031a00/0x5b377f42a7a7dc6f lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.083941:0:19570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feba00/0x5b377f42a7a7dc76 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cd8 expref: 23 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.083965:0:19570:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031a00/0x5b377f42a7a7dc6f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.083979:0:19570:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feba00/0x5b377f42a7a7dc76 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cd8 expref: 23 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.083994:0:19570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:2.0:1788748637.083998:0:19570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788748637.084002:0:19570:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feba00/0x5b377f42a7a7dc76 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cd8 expref: 23 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.084011:0:19570:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc8feba00, rc 0) 00000100:00100000:2.0:1788748637.084126:0:19570:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4430730-ba8d-423d-b041-116ce5a3d089+23:17392:x1875638358262784:12345-192.168.203.4@tcp:101:dd.0 Request processed in 357us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748637.084134:0:19570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 38 00010000:00010000:2.0:1788748637.293312:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788748637.613641:0:18897:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788748637.613650:0:18897:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788748637.613688:0:18897:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788748637.613696:0:18897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788748637.613834:0:18897:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7270e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18897:1875638377120640:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788748637.613948:0:18897:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced1bb5600 going to sleep for 11 seconds 00000100:00100000:3.0:1788748637.619832:0:18897:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7270e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18897:1875638377120640:192.168.203.4@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788748637.622064:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748637.627466:0:18873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358262912 00000100:00100000:2.0:1788748637.627482:0:18873:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358262912 00000100:00100000:2.0:1788748637.627624:0:18873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:2.0:1788748637.627637:0:18873:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d4430730-ba8d-423d-b041-116ce5a3d089+23:17394:x1875638358262912:12345-192.168.203.4@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788748637.627733:0:18873:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d4430730-ba8d-423d-b041-116ce5a3d089+23:17394:x1875638358262912:12345-192.168.203.4@tcp:900:lhsmtool_posix.0 Request processed in 98us (5677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748637.627741:0:18873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:0.0:1788748637.636689:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748637.636776:0:18862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358263040 00000100:00100000:2.0:1788748637.636786:0:18862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358263040 00000100:00100000:2.0:1788748637.636843:0:18862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:2.0:1788748637.636853:0:18862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4430730-ba8d-423d-b041-116ce5a3d089+23:17394:x1875638358263040:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788748637.636886:0:18862:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788748637.636996:0:18862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4430730-ba8d-423d-b041-116ce5a3d089+23:17394:x1875638358263040:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 143us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748637.637003:0:18862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:0.0:1788748637.643355:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748637.645231:0:18864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358263168 00000100:00100000:2.0:1788748637.645248:0:18864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358263168 00000100:00100000:2.0:1788748637.645444:0:18864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 40 00000100:00100000:2.0:1788748637.645456:0:18864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4430730-ba8d-423d-b041-116ce5a3d089+23:17394:x1875638358263168:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788748637.645528:0:18864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc7d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.645545:0:18864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc7d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.645556:0:18864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc7d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.645571:0:18864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feac00/0x5b377f42a7a7dc84 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.645591:0:18864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feac00/0x5b377f42a7a7dc84 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.645599:0:18864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feac00/0x5b377f42a7a7dc84 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.645623:0:18864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feb800/0x5b377f42a7a7dc8b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.645632:0:18864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feb800/0x5b377f42a7a7dc8b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.645638:0:18864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feb800/0x5b377f42a7a7dc8b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748637.645679:0:18864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788748637.645683:0:18864:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788748637.645698:0:18864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feb800/0x5b377f42a7a7dc8b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.645709:0:18864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc7d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.645716:0:18864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc7d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.645723:0:18864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc7d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.645730:0:18864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc8fea400 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748637.645734:0:18864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc7d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.645747:0:18864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc7d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.645759:0:18864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cec6646600) 00010000:00010000:2.0:1788748637.645762:0:18864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748637.645767:0:18864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc7d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.645773:0:18864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea400/0x5b377f42a7a7dc7d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.645787:0:18864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feac00/0x5b377f42a7a7dc84 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.645792:0:18864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feac00/0x5b377f42a7a7dc84 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.645797:0:18864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feac00/0x5b377f42a7a7dc84 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.645802:0:18864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc8feac00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748637.645805:0:18864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feac00/0x5b377f42a7a7dc84 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.645811:0:18864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feac00/0x5b377f42a7a7dc84 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.645817:0:18864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff99cec4ec0400) 00010000:00010000:2.0:1788748637.645819:0:18864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748637.645822:0:18864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feac00/0x5b377f42a7a7dc84 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.645837:0:18864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feac00/0x5b377f42a7a7dc84 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.645851:0:18864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feb800/0x5b377f42a7a7dc8b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.645857:0:18864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feb800/0x5b377f42a7a7dc8b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.645863:0:18864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feb800/0x5b377f42a7a7dc8b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.645867:0:18864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc8feb800 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748637.645870:0:18864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feb800/0x5b377f42a7a7dc8b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.645876:0:18864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feb800/0x5b377f42a7a7dc8b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.645884:0:18864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:2.0:1788748637.645886:0:18864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748637.645889:0:18864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feb800/0x5b377f42a7a7dc8b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.645894:0:18864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feb800/0x5b377f42a7a7dc8b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748637.645977:0:18864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4430730-ba8d-423d-b041-116ce5a3d089+23:17394:x1875638358263168:12345-192.168.203.4@tcp:34:lhsmtool_posix.0 Request processed in 522us (2635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748637.645985:0:18864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 40 00000100:00100000:3.0:1788748637.649816:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748637.649903:0:18862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358263424 00000100:00100000:2.0:1788748637.649919:0:18862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358263424 00000100:00100000:2.0:1788748637.650105:0:18862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 41 00000100:00100000:2.0:1788748637.650124:0:18862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4430730-ba8d-423d-b041-116ce5a3d089+23:17394:x1875638358263424:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788748637.650146:0:18862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748637.650176:0:18862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febc00/0x5b377f42a7a7dc92 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521cdf expref: -99 pid: 18862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.650299:0:18862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febe00/0x5b377f42a7a7dc99 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.650315:0:18862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febe00/0x5b377f42a7a7dc99 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.650327:0:18862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febe00/0x5b377f42a7a7dc99 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748637.650339:0:18862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788748637.650442:0:18862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febe00/0x5b377f42a7a7dc99 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.650450:0:18862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febe00/0x5b377f42a7a7dc99 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.650457:0:18862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febe00/0x5b377f42a7a7dc99 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.650464:0:18862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc8febe00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748637.650468:0:18862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febe00/0x5b377f42a7a7dc99 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.650476:0:18862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febe00/0x5b377f42a7a7dc99 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.650502:0:18862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:2.0:1788748637.650505:0:18862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788748637.650511:0:18862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febe00/0x5b377f42a7a7dc99 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.650517:0:18862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febe00/0x5b377f42a7a7dc99 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.650560:0:18862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febc00/0x5b377f42a7a7dc92 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cdf expref: 25 pid: 18862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.650570:0:18862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cec6646600) 00010000:00010000:2.0:1788748637.650572:0:18862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788748637.650575:0:18862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febc00/0x5b377f42a7a7dc92 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cdf expref: 25 pid: 18862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.650585:0:18862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc8febc00, rc 0) 00000100:00100000:2.0:1788748637.650645:0:18862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4430730-ba8d-423d-b041-116ce5a3d089+24:17394:x1875638358263424:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 523us (844us total) trans 12884901908 rc 301/301 00000100:00100000:2.0:1788748637.650652:0:18862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 41 00000100:00100000:3.0:1788748637.658741:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748637.658827:0:18864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358263552 00000100:00100000:2.0:1788748637.658843:0:18864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358263552 00000100:00100000:2.0:1788748637.658924:0:18864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:2.0:1788748637.658935:0:18864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4430730-ba8d-423d-b041-116ce5a3d089+24:17394:x1875638358263552:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788748637.658993:0:18864:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788748637.659220:0:18864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4430730-ba8d-423d-b041-116ce5a3d089+24:17394:x1875638358263552:12345-192.168.203.4@tcp:53:lhsmtool_posix.0 Request processed in 285us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748637.659238:0:18864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:1.0:1788748637.665431:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748637.665868:0:18863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358263808 00000100:00100000:0.0:1788748637.665886:0:18863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358263808 00000100:00100000:0.0:1788748637.666209:0:18863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:0.0:1788748637.666224:0:18863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4430730-ba8d-423d-b041-116ce5a3d089+24:17394:x1875638358263808:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788748637.666253:0:18863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748637.666281:0:18863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dca7 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521ce6 expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788748637.668087:0:18863:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =59 00000004:00080000:0.0:1788748637.668103:0:18863:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+59 in llog 00000004:00080000:0.0:1788748637.668172:0:18863:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x42:0x0], index 0: 0 00010000:00010000:0.0:1788748637.668556:0:18863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030a00/0x5b377f42a7a7dcae lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.668577:0:18863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030a00/0x5b377f42a7a7dcae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.668604:0:18863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030a00/0x5b377f42a7a7dcae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.668693:0:18863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dca7 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ce6 expref: 27 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.668716:0:18863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030a00/0x5b377f42a7a7dcae lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ce6 expref: 26 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.668726:0:18863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99cec3e09300) 00010000:00010000:0.0:1788748637.668729:0:18863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788748637.668733:0:18863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cec0030a00, rc 0) 00000100:00100000:0.0:1788748637.668828:0:18863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4430730-ba8d-423d-b041-116ce5a3d089+26:17394:x1875638358263808:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 2608us (3408us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1788748637.668839:0:18863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:3.0:1788748637.673689:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748637.675090:0:18864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358264064 00000100:00100000:2.0:1788748637.675111:0:18864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358264064 00000100:00100000:2.0:1788748637.675204:0:18864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:2.0:1788748637.675217:0:18864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4430730-ba8d-423d-b041-116ce5a3d089+26:17394:x1875638358264064:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788748637.675296:0:18864:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748637.675332:0:18864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030a00/0x5b377f42a7a7dcae lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ce6 expref: 26 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.675358:0:18864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99cec3e09300) 00010000:00010000:2.0:1788748637.675383:0:18864:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788748637.675413:0:18864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febc00/0x5b377f42a7a7dcbc lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.675429:0:18864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febc00/0x5b377f42a7a7dcbc lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.675441:0:18864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febc00/0x5b377f42a7a7dcbc lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.675457:0:18864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febe00/0x5b377f42a7a7dcc3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x15d1d4d4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.675465:0:18864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febe00/0x5b377f42a7a7dcc3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x15d1d4d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.675472:0:18864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febe00/0x5b377f42a7a7dcc3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x15d1d4d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.675576:0:18864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febc00/0x5b377f42a7a7dcbc lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.675584:0:18864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febc00/0x5b377f42a7a7dcbc lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.675591:0:18864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febc00/0x5b377f42a7a7dcbc lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.675598:0:18864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc8febc00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748637.675604:0:18864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febc00/0x5b377f42a7a7dcbc lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.675613:0:18864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febc00/0x5b377f42a7a7dcbc lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.675621:0:18864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99cec6646400) 00010000:00010000:2.0:1788748637.675625:0:18864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748637.675630:0:18864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febc00/0x5b377f42a7a7dcbc lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.675636:0:18864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febc00/0x5b377f42a7a7dcbc lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.675646:0:18864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febe00/0x5b377f42a7a7dcc3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x15d1d4d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.675652:0:18864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febe00/0x5b377f42a7a7dcc3 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x15d1d4d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.675658:0:18864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febe00/0x5b377f42a7a7dcc3 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x15d1d4d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.675672:0:18864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc8febe00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:2.0:1788748637.675675:0:18864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febe00/0x5b377f42a7a7dcc3 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x15d1d4d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.675681:0:18864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febe00/0x5b377f42a7a7dcc3 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x15d1d4d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.675690:0:18864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x15d1d4d4 (ffff99cec4ec0400) 00010000:00010000:2.0:1788748637.675693:0:18864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748637.675696:0:18864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febe00/0x5b377f42a7a7dcc3 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x15d1d4d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.675702:0:18864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8febe00/0x5b377f42a7a7dcc3 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x15d1d4d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748637.675806:0:18864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4430730-ba8d-423d-b041-116ce5a3d089+25:17394:x1875638358264064:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 591us (2132us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788748637.675815:0:18864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:3.0:1788748637.679746:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748637.679855:0:18862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358264192 00000100:00100000:1.0:1788748637.679870:0:18862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358264192 00000100:00100000:1.0:1788748637.679946:0:18862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00100000:1.0:1788748637.679981:0:18862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4430730-ba8d-423d-b041-116ce5a3d089+25:17394:x1875638358264192:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788748637.680010:0:18862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748637.680096:0:18862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7dcca lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521ced expref: -99 pid: 18862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.680145:0:18862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5e00/0x5b377f42a7a7dcd1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.680161:0:18862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5e00/0x5b377f42a7a7dcd1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.680175:0:18862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5e00/0x5b377f42a7a7dcd1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.680291:0:18862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e4000/0x5b377f42a7a7dcca lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ced expref: 27 pid: 18862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.680311:0:18862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5e00/0x5b377f42a7a7dcd1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521ced expref: 26 pid: 18862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.680320:0:18862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99cece6d7000) 00010000:00010000:1.0:1788748637.680323:0:18862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788748637.680328:0:18862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ced13e5e00, rc 0) 00000100:00100000:1.0:1788748637.680410:0:18862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4430730-ba8d-423d-b041-116ce5a3d089+26:17394:x1875638358264192:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 433us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748637.680418:0:18862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00100000:1.0:1788748637.687504:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748637.687621:0:18864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358264448 00000100:00100000:2.0:1788748637.687634:0:18864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358264448 00000100:00100000:1.0:1788748637.687878:0:18864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00100000:1.0:1788748637.687892:0:18864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4430730-ba8d-423d-b041-116ce5a3d089+26:17394:x1875638358264448:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788748637.688060:0:18864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5a00/0x5b377f42a7a7dcd8 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.688081:0:18864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5a00/0x5b377f42a7a7dcd8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.688096:0:18864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5a00/0x5b377f42a7a7dcd8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788748637.688653:0:18864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:1.0:1788748637.688668:0:18864:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 554731652769ns, next at 555731649241ns, rc = 0 00000004:00010000:1.0:1788748637.688913:0:18864:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000e5be99d5 reply state 00000000ab1aefe7 transno 12884901910 ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5a00/0x5b377f42a7a7dcd8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748637.688924:0:18864:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788748637.689234:0:18864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4430730-ba8d-423d-b041-116ce5a3d089+28:17394:x1875638358264448:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 1343us (1741us total) trans 12884901910 rc 0/0 00000100:00100000:1.0:1788748637.689243:0:18864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00100000:1.0:1788748637.693323:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748637.693752:0:18862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358264576 00000100:00100000:2.0:1788748637.693765:0:18862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358264576 00000100:00100000:2.0:1788748637.693858:0:18862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 47 00000100:00100000:2.0:1788748637.693870:0:18862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4430730-ba8d-423d-b041-116ce5a3d089+28:17394:x1875638358264576:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788748637.694092:0:18862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748637.694174:0:18862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7dcdf lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521cf4 expref: -99 pid: 18862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.694262:0:18862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7dcdf lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cf4 expref: 29 pid: 18862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.694281:0:18862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7dcdf lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cf4 expref: 29 pid: 18862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.694307:0:18862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99cece6d7000) 00010000:00010000:1.0:1788748637.694326:0:18862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788748637.694331:0:18862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f8600, rc 0) 00000100:00100000:1.0:1788748637.694426:0:18862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4430730-ba8d-423d-b041-116ce5a3d089+29:17394:x1875638358264576:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 558us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748637.694434:0:18862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 47 00000100:00100000:1.0:1788748637.697341:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748637.697524:0:19549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358264704 00000100:00100000:2.0:1788748637.697537:0:19549:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358264704 00000100:00100000:2.0:1788748637.697633:0:19549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:2.0:1788748637.697645:0:19549:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4430730-ba8d-423d-b041-116ce5a3d089+5:2348:x1875638358264704:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788748637.698450:0:19549:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4430730-ba8d-423d-b041-116ce5a3d089+6:2348:x1875638358264704:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 801us (1117us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788748637.698460:0:19549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00010000:00010000:0.0:1788748637.698559:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5a00/0x5b377f42a7a7dcd8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.698573:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5a00/0x5b377f42a7a7dcd8 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.698582:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5a00/0x5b377f42a7a7dcd8 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.698590:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ced13e5a00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:0.0:1788748637.698596:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5a00/0x5b377f42a7a7dcd8 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.698605:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5a00/0x5b377f42a7a7dcd8 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.698634:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99cece6d7000) 00010000:00010000:0.0:1788748637.698637:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788748637.698644:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5a00/0x5b377f42a7a7dcd8 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.698651:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ced13e5a00/0x5b377f42a7a7dcd8 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788748637.698783:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788748637.701772:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748637.701973:0:18865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358264960 00000100:00100000:1.0:1788748637.701987:0:18865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358264960 00000100:00100000:1.0:1788748637.702207:0:18865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:1.0:1788748637.702219:0:18865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb809c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4430730-ba8d-423d-b041-116ce5a3d089+28:17394:x1875638358264960:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788748637.702530:0:18865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb809c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4430730-ba8d-423d-b041-116ce5a3d089+29:17394:x1875638358264960:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 312us (779us total) trans 12884901911 rc 0/0 00000100:00100000:1.0:1788748637.702538:0:18865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:2.0:1788748637.711588:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748637.711705:0:19570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358265216 00000100:00100000:0.0:1788748637.711717:0:19570:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358265216 00000100:00100000:0.0:1788748637.711798:0:19570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 48 00000100:00100000:0.0:1788748637.711811:0:19570:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb80bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4430730-ba8d-423d-b041-116ce5a3d089+29:17394:x1875638358265216:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788748637.711970:0:19570:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb80bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4430730-ba8d-423d-b041-116ce5a3d089+29:17394:x1875638358265216:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 161us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748637.711978:0:19570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 48 00000100:00100000:2.0:1788748637.715150:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748637.715274:0:18863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358265344 00000100:00100000:1.0:1788748637.715287:0:18863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358265344 00000100:00100000:1.0:1788748637.715362:0:18863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00100000:1.0:1788748637.715384:0:18863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4430730-ba8d-423d-b041-116ce5a3d089+29:17394:x1875638358265344:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788748637.715411:0:18863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748637.715437:0:18863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7dce6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521cfb expref: -99 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.715527:0:18863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7dced lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.715566:0:18863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7dced lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.715581:0:18863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7dced lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748637.715629:0:18863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788748637.715650:0:18863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7dced lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.715681:0:18863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7dce6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cfb expref: 31 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.715704:0:18863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7dced lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cfb expref: 30 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.715712:0:18863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99cece6d7000) 00010000:00010000:1.0:1788748637.715716:0:18863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788748637.715720:0:18863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ceed6f8e00, rc 0) 00000100:00100000:1.0:1788748637.715810:0:18863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4430730-ba8d-423d-b041-116ce5a3d089+30:17394:x1875638358265344:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 438us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748637.715817:0:18863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00100000:2.0:1788748637.718762:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748637.718878:0:19547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358265472 00000100:00100000:3.0:1788748637.718891:0:19547:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358265472 00000100:00100000:3.0:1788748637.718961:0:19547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:3.0:1788748637.718973:0:19547:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4430730-ba8d-423d-b041-116ce5a3d089+6:2347:x1875638358265472:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788748637.718996:0:19547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748637.719562:0:19547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007788facd/0x5b377f42a7a7dcf4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521d02 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788748637.719605:0:19547:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e235d, blocks: 0x1 00010000:00010000:2.0:1788748637.719636:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=554s v=(0 0) 00010000:00010000:2.0:1788748637.719641:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748637.719655:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007788facd/0x5b377f42a7a7dcf4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521d02 expref: 7 pid: 19547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.719680:0:19547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007788facd/0x5b377f42a7a7dcf4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521d02 expref: 7 pid: 19547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.719695:0:19547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc8fea400, rc 0) 00000100:00100000:2.0:1788748637.719928:0:19547:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4430730-ba8d-423d-b041-116ce5a3d089+7:2347:x1875638358265472:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 956us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748637.719938:0:19547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:3.0:1788748637.723323:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748637.723441:0:19570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358265728 00000100:00100000:0.0:1788748637.723453:0:19570:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358265728 00000100:00100000:0.0:1788748637.723527:0:19570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 50 00000100:00100000:0.0:1788748637.723539:0:19570:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4430730-ba8d-423d-b041-116ce5a3d089+30:17394:x1875638358265728:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788748637.723738:0:19570:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4430730-ba8d-423d-b041-116ce5a3d089+30:17394:x1875638358265728:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 200us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748637.723746:0:19570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 50 00000100:00100000:1.0:1788748637.726616:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748637.726719:0:18863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358265856 00000100:00100000:0.0:1788748637.726732:0:18863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358265856 00000100:00100000:0.0:1788748637.726958:0:18863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:0.0:1788748637.726972:0:18863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4430730-ba8d-423d-b041-116ce5a3d089+30:17394:x1875638358265856:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788748637.771407:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901909 is committed 00000100:00100000:1.0:1788748637.771618:0:18863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4430730-ba8d-423d-b041-116ce5a3d089+27:17394:x1875638358265856:12345-192.168.203.4@tcp:44:lhsmtool_posix.0 Request processed in 44641us (45006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748637.771916:0:18863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 51 00000001:00080000:2.0:1788748637.772442:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901892 is committed 00000001:00080000:2.0:1788748637.772456:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901911 is committed 00000004:00080000:2.0:1788748637.772465:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788748637.772482:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901894 is committed 00000001:00080000:2.0:1788748637.772500:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:2.0:1788748637.772788:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788748637.772812:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7270000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377120768:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788748637.772903:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748637.773181:0:19548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377120768 00000100:00100000:0.0:1788748637.773191:0:19548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377120768 00000100:00100000:0.0:1788748637.773266:0:19548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788748637.773278:0:19548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb80b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377120768:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788748637.773507:0:19548:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788748637.773511:0:19548:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788748637.773514:0:19548:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788748637.773516:0:19548:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1788748637 -> 1788748637 00002000:00010000:0.0:1788748637.773519:0:19548:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788748637.773578:0:19548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb80b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875638377120768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 302us (674us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1788748637.773586:0:19548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788748637.773927:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788748637.774157:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99cef7270000/2, rc 0, transno 12884901891 00000100:00100000:2.0:1788748637.774166:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7270000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377120768:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788748637.774944:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748637.775198:0:19549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358265984 00000100:00100000:1.0:1788748637.775208:0:19549:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358265984 00000100:00100000:1.0:1788748637.775287:0:19549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:1.0:1788748637.775298:0:19549:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb80a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4430730-ba8d-423d-b041-116ce5a3d089+7:2349:x1875638358265984:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788748637.775430:0:19549:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb80a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4430730-ba8d-423d-b041-116ce5a3d089+7:2349:x1875638358265984:12345-192.168.203.4@tcp:16:lhsmtool_posix.0 Request processed in 133us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748637.775442:0:19549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:3.0:1788748637.778343:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748637.778501:0:19570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358266240 00000100:00100000:0.0:1788748637.778514:0:19570:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358266240 00000100:00100000:0.0:1788748637.778590:0:19570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:0.0:1788748637.778602:0:19570:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4430730-ba8d-423d-b041-116ce5a3d089+14:17394:x1875638358266240:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788748637.779202:0:19570:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748637.779241:0:19570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8e00/0x5b377f42a7a7dced lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cfb expref: 14 pid: 18863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.779388:0:19570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99cece6d7000) 00010000:00010000:0.0:1788748637.779395:0:19570:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788748637.779441:0:19570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dcfb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.779458:0:19570:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dcfb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.779493:0:19570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dcfb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788748637.780216:0:19570:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000ba1f7d3a reply state 00000000449acafd transno 12884901912 ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dcfb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748637.780229:0:19570:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788748637.780369:0:19570:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4430730-ba8d-423d-b041-116ce5a3d089+15:17394:x1875638358266240:12345-192.168.203.4@tcp:36:lhsmtool_posix.0 Request processed in 1767us (2037us total) trans 12884901912 rc 0/0 00000100:00100000:0.0:1788748637.780389:0:19570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 52 00010000:00010000:1.0:1788748637.782302:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dcfb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.782322:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dcfb lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.782330:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dcfb lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.782337:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec0031200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748637.782342:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dcfb lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.782350:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dcfb lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.782369:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99cece6d7000) 00010000:00010000:1.0:1788748637.782383:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748637.782389:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dcfb lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.782396:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031200/0x5b377f42a7a7dcfb lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748637.783451:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748637.783688:0:19547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358266368 00000100:00100000:2.0:1788748637.783701:0:19547:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358266368 00000100:00100000:2.0:1788748637.783883:0:19547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:2.0:1788748637.783896:0:19547:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4430730-ba8d-423d-b041-116ce5a3d089+7:17394:x1875638358266368:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788748637.783921:0:19547:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748637.783945:0:19547:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045fd9ff1/0x5b377f42a7a7dd02 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f1dee6226521d09 expref: -99 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.783988:0:19547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007788facd/0x5b377f42a7a7dcf4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521d02 expref: 8 pid: 19547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.783998:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748637.784003:0:19547:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748637.784009:0:19547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045fd9ff1/0x5b377f42a7a7dd02 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521d09 expref: 8 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.785111:0:19547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007788facd/0x5b377f42a7a7dcf4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521d02 expref: 8 pid: 19547 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.785132:0:19547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007788facd/0x5b377f42a7a7dcf4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521d02 expref: 8 pid: 19547 timeout: 654 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748637.785168:0:19547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb808a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:19547:1875638377120896:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788748637.786531:0:19547:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed786780 going to sleep for 11 seconds 00000100:00100000:2.0:1788748637.791628:0:19547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb808a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:19547:1875638377120896:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788748637.791678:0:19547:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000045fd9ff1/0x5b377f42a7a7dd02 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521d09 expref: 8 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.791705:0:19547:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc8feb600, rc 0) 00000100:00100000:2.0:1788748637.791831:0:19547:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4430730-ba8d-423d-b041-116ce5a3d089+8:17394:x1875638358266368:12345-192.168.203.4@tcp:101:lhsmtool_posix.0 Request processed in 7936us (8389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748637.791842:0:19547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:3.0:1788748637.793546:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748637.793963:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358266496 00000100:00100000:2.0:1788748637.793977:0:18849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358266496 00010000:00010000:2.0:1788748637.794085:0:18849:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007788facd/0x5b377f42a7a7dcf4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521d02 expref: 8 pid: 19547 timeout: 654 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748637.794130:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:2.0:1788748637.794141:0:18849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4430730-ba8d-423d-b041-116ce5a3d089+8:2347:x1875638358266496:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748637.794162:0:18849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748637.794189:0:18849:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007788facd/0x5b377f42a7a7dcf4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521d02 expref: 8 pid: 19547 timeout: 654 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.794205:0:18849:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007788facd/0x5b377f42a7a7dcf4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521d02 expref: 8 pid: 19547 timeout: 654 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.794255:0:18849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007788facd/0x5b377f42a7a7dcf4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521d02 expref: 8 pid: 19547 timeout: 654 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.794276:0:18849:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748637.794281:0:18849:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748637.794288:0:18849:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000045fd9ff1/0x5b377f42a7a7dd02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521d09 expref: 7 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.794301:0:18849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045fd9ff1/0x5b377f42a7a7dd02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521d09 expref: 7 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.794347:0:18849:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000045fd9ff1/0x5b377f42a7a7dd02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521d09 expref: 7 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748637.794363:0:18849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb808a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:18849:1875638377121024:192.168.203.4@tcp:105: 00000100:00100000:2.0:1788748637.794474:0:18849:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed786780 going to sleep for 11 seconds 00000100:00100000:3.0:1788748637.801069:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748637.801185:0:18849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb808a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:18849:1875638377121024:192.168.203.4@tcp:105: 00010000:00010000:2.0:1788748637.801215:0:18849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748637.801277:0:18849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4430730-ba8d-423d-b041-116ce5a3d089+7:2347:x1875638358266496:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 7137us (7741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748637.801290:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:1.0:1788748637.801463:0:20347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358266624 00000100:00100000:1.0:1788748637.801473:0:20347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358266624 00000100:00100000:1.0:1788748637.801549:0:20347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:1.0:1788748637.801560:0:20347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef730d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4430730-ba8d-423d-b041-116ce5a3d089+7:2347:x1875638358266624:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788748637.801841:0:20347:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788748637.801845:0:20347:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 0 -> 1788748636 00002000:00010000:1.0:1788748637.801848:0:20347:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb atime from disk: 0 -> 1788748635 00002000:00010000:1.0:1788748637.801850:0:20347:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1788748637 -> 1788748636 00002000:00010000:1.0:1788748637.801851:0:20347:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788748637.801941:0:20347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef730d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4430730-ba8d-423d-b041-116ce5a3d089+8:2347:x1875638358266624:12345-192.168.203.4@tcp:2:lhsmtool_posix.0 Request processed in 382us (885us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1788748637.801948:0:20347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:3.0:1788748637.810191:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748637.810502:0:20940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358266752 00000100:00100000:2.0:1788748637.810517:0:20940:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358266752 00000100:00100000:2.0:1788748637.810594:0:20940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:2.0:1788748637.810625:0:20940:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4430730-ba8d-423d-b041-116ce5a3d089+8:2348:x1875638358266752:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788748637.810696:0:20940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000056c48405/0x5b377f42a7a7dd09 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.810722:0:20940:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000045fd9ff1/0x5b377f42a7a7dd02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521d09 expref: 8 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.810742:0:20940:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748637.810748:0:20940:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788748637.810752:0:20940:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056c48405/0x5b377f42a7a7dd09 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.810800:0:20940:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000045fd9ff1/0x5b377f42a7a7dd02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521d09 expref: 8 pid: 19547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.810817:0:20940:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000045fd9ff1/0x5b377f42a7a7dd02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521d09 expref: 8 pid: 19547 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748637.810834:0:20940:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb808a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20940:1875638377121152:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788748637.810954:0:20940:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed786780 going to sleep for 11 seconds 00000100:00100000:2.0:1788748637.815474:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748637.815592:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358266880 00000100:00100000:3.0:1788748637.815605:0:18847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358266880 00010000:00010000:3.0:1788748637.815669:0:18847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000045fd9ff1/0x5b377f42a7a7dd02 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521d09 expref: 9 pid: 19547 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748637.815720:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:3.0:1788748637.815739:0:18847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb809880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4430730-ba8d-423d-b041-116ce5a3d089+9:2348:x1875638358266880:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748637.815758:0:18847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748637.815786:0:18847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000045fd9ff1/0x5b377f42a7a7dd02 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521d09 expref: 9 pid: 19547 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748637.815801:0:18847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000045fd9ff1/0x5b377f42a7a7dd02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521d09 expref: 9 pid: 19547 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748637.815833:0:18847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788748637.815839:0:18847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788748637.815851:0:18847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056c48405/0x5b377f42a7a7dd09 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 20940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748637.815864:0:18847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056c48405/0x5b377f42a7a7dd09 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 20940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748637.815889:0:18847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748637.816968:0:18847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb809880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4430730-ba8d-423d-b041-116ce5a3d089+9:2348:x1875638358266880:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 1226us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748637.817001:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14 00010000:00010000:1.0:1788748637.817245:0:20940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045fd9ff1/0x5b377f42a7a7dd02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521d09 expref: 8 pid: 19547 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748637.817267:0:20940:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb808a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20940:1875638377121152:192.168.203.4@tcp:104: 00010000:00010000:1.0:1788748637.817296:0:20940:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056c48405/0x5b377f42a7a7dd09 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.817308:0:20940:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056c48405/0x5b377f42a7a7dd09 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.817316:0:20940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056c48405/0x5b377f42a7a7dd09 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.817356:0:20940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000056c48405/0x5b377f42a7a7dd09 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.817391:0:20940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056c48405/0x5b377f42a7a7dd09 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.817401:0:20940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056c48405/0x5b377f42a7a7dd09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.817408:0:20940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc8feaa00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748637.817413:0:20940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056c48405/0x5b377f42a7a7dd09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.817423:0:20940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056c48405/0x5b377f42a7a7dd09 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.817444:0:20940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056c48405/0x5b377f42a7a7dd09 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.817451:0:20940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056c48405/0x5b377f42a7a7dd09 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748637.817534:0:20940:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4430730-ba8d-423d-b041-116ce5a3d089+7:2348:x1875638358266752:12345-192.168.203.4@tcp:1:lhsmtool_posix.0 Request processed in 6913us (7358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748637.817543:0:20940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:3.0:1788748637.821289:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748637.821448:0:18862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358267136 00000100:00100000:2.0:1788748637.821461:0:18862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358267136 00000100:00100000:2.0:1788748637.821536:0:18862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 53 00000100:00100000:2.0:1788748637.821548:0:18862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4430730-ba8d-423d-b041-116ce5a3d089+14:17394:x1875638358267136:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788748637.821670:0:18862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea600/0x5b377f42a7a7dd10 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.821709:0:18862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea600/0x5b377f42a7a7dd10 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.821722:0:18862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea600/0x5b377f42a7a7dd10 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.822396:0:18862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea200/0x5b377f42a7a7dd17 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.822416:0:18862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7dcdf lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cf4 expref: 15 pid: 18862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.822426:0:18862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea200/0x5b377f42a7a7dd17 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.822472:0:18862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7dcdf lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cf4 expref: 15 pid: 18862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.822489:0:18862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7dcdf lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cf4 expref: 15 pid: 18862 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748637.822506:0:18862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefb809500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18862:1875638377121280:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788748637.822619:0:18862:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed786b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788748637.831123:0:18862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefb809500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18862:1875638377121280:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788748637.831164:0:18862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea200/0x5b377f42a7a7dd17 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748637.831465:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748637.831775:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358267264 00000100:00100000:2.0:1788748637.831802:0:18849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358267264 00010000:00010000:2.0:1788748637.832252:0:18849:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7dcdf lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cf4 expref: 16 pid: 18862 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748637.832305:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:2.0:1788748637.832319:0:18849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4430730-ba8d-423d-b041-116ce5a3d089+16:2347:x1875638358267264:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748637.832338:0:18849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748637.832345:0:18849:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7dcdf lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cf4 expref: 16 pid: 18862 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.832359:0:18849:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7dcdf lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cf4 expref: 16 pid: 18862 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.832395:0:18849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f8600/0x5b377f42a7a7dcdf lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cf4 expref: 16 pid: 18862 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.832417:0:18849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99cece6d7000) 00010000:00010000:2.0:1788748637.832423:0:18849:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea200/0x5b377f42a7a7dd17 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.832436:0:18849:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea200/0x5b377f42a7a7dd17 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.832445:0:18849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea200/0x5b377f42a7a7dd17 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748637.832481:0:18849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748637.832545:0:18849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4430730-ba8d-423d-b041-116ce5a3d089+15:2347:x1875638358267264:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 230us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748637.832565:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 15 00010000:00010000:1.0:1788748637.832654:0:18862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea200/0x5b377f42a7a7dd17 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.832682:0:18862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea200/0x5b377f42a7a7dd17 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788748637.833071:0:18862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:1.0:1788748637.833236:0:18862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000001:00080000:1.0:1788748637.833280:0:18862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:1.0:1788748637.835313:0:18862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c92300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:18862:1875638377121408:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788748637.835432:0:18862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748637.835479:0:18862:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ceed4a7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788748637.835617:0:18867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377121408 00000100:00100000:3.0:1788748637.835639:0:18867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377121408 00000100:00100000:3.0:1788748637.835699:0:18867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788748637.835710:0:18867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18862:x1875638377121408:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788748637.835829:0:18867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18862:x1875638377121408:12345-0@lo:1000:mdt00_000.0 Request processed in 120us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748637.835837:0:18867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788748637.836195:0:18862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c92300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:18862:1875638377121408:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788748637.837577:0:18862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901916 00000100:00100000:1.0:1788748637.837714:0:18862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c92300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:18862:1875638377121536:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788748637.837791:0:18862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748637.837833:0:18862:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced1a0ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788748637.838788:0:18867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377121536 00000100:00100000:3.0:1788748637.838801:0:18867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377121536 00000100:00100000:3.0:1788748637.838884:0:18867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788748637.838895:0:18867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18862:x1875638377121536:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788748637.839227:0:18867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:18862:x1875638377121536:12345-0@lo:1000:mdt00_000.0 Request processed in 332us (1434us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788748637.839236:0:18867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788748637.839394:0:18862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c92300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:18862:1875638377121536:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788748637.839464:0:18862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea200/0x5b377f42a7a7dd17 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.839476:0:18862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea200/0x5b377f42a7a7dd17 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.839485:0:18862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea200/0x5b377f42a7a7dd17 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.839492:0:18862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc8fea200 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748637.839496:0:18862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea200/0x5b377f42a7a7dd17 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.839527:0:18862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea200/0x5b377f42a7a7dd17 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.839549:0:18862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99cece6d7000) 00010000:00010000:1.0:1788748637.839552:0:18862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788748637.839559:0:18862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea200/0x5b377f42a7a7dd17 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.839565:0:18862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea200/0x5b377f42a7a7dd17 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.839605:0:18862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031a00/0x5b377f42a7a7dc6f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.839612:0:18862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031a00/0x5b377f42a7a7dc6f lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.839619:0:18862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031a00/0x5b377f42a7a7dc6f lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.839625:0:18862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec0031a00 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748637.839628:0:18862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031a00/0x5b377f42a7a7dc6f lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.839638:0:18862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031a00/0x5b377f42a7a7dc6f lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.839647:0:18862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:1.0:1788748637.839650:0:18862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788748637.839658:0:18862:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feba00/0x5b377f42a7a7dc76 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cd8 expref: 18 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.839682:0:18862:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feba00/0x5b377f42a7a7dc76 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cd8 expref: 18 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.839692:0:18862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feba00/0x5b377f42a7a7dc76 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cd8 expref: 18 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.839758:0:18862:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8feba00/0x5b377f42a7a7dc76 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x5f1dee6226521cd8 expref: 18 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748637.839775:0:18862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c90700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18862:1875638377121664:192.168.203.4@tcp:105: 00000100:00100000:1.0:1788748637.839887:0:18862:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ced1a0e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748637.842165:0:18862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c90700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18862:1875638377121664:192.168.203.4@tcp:105: 00010000:00010000:1.0:1788748637.842203:0:18862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031a00/0x5b377f42a7a7dc6f lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.842215:0:18862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0031a00/0x5b377f42a7a7dc6f lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.842257:0:18862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7dd1e lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.842274:0:18862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7dd1e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.842288:0:18862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7dd1e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.842300:0:18862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7dd1e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.842322:0:18862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7dd1e lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.842329:0:18862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7dd1e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.842335:0:18862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748637.842339:0:18862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7dd1e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.842347:0:18862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7dd1e lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.842361:0:18862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:1.0:1788748637.842365:0:18862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748637.842369:0:18862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7dd1e lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.843009:0:18862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ceed6f9600/0x5b377f42a7a7dd1e lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.843061:0:18862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea600/0x5b377f42a7a7dd10 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.843068:0:18862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea600/0x5b377f42a7a7dd10 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.843075:0:18862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea600/0x5b377f42a7a7dd10 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.843081:0:18862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc8fea600 already unused, calling callback (ffffffffc21454f0) 00010000:00010000:1.0:1788748637.843095:0:18862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea600/0x5b377f42a7a7dd10 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.843103:0:18862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea600/0x5b377f42a7a7dd10 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.843116:0:18862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99cec3e09100) 00010000:00010000:1.0:1788748637.843119:0:18862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788748637.843123:0:18862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea600/0x5b377f42a7a7dd10 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748637.843130:0:18862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc8fea600/0x5b377f42a7a7dd10 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748637.843516:0:18862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4430730-ba8d-423d-b041-116ce5a3d089+18:17394:x1875638358267136:12345-192.168.203.4@tcp:57:lhsmtool_posix.0 Request processed in 21965us (22235us total) trans 12884901917 rc 0/0 00000100:00100000:1.0:1788748637.843530:0:18862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 53 00000020:00080000:1.0:1788748637.843538:0:18862:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788748637.843685:0:18897:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788748637.843691:0:18897:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788748637.843739:0:18897:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788748637.843746:0:18897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788748637.843873:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748637.844668:0:18865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358267392 00000100:00100000:1.0:1788748637.844681:0:18865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358267392 00000100:00100000:1.0:1788748637.844750:0:18865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:1.0:1788748637.844763:0:18865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cf01dde850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4430730-ba8d-423d-b041-116ce5a3d089+18:17392:x1875638358267392:12345-192.168.203.4@tcp:49:dd.0 00000100:00100000:1.0:1788748637.844927:0:18865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cf01dde850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4430730-ba8d-423d-b041-116ce5a3d089+18:17392:x1875638358267392:12345-192.168.203.4@tcp:49:dd.0 Request processed in 167us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748637.844935:0:18865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:3.0:1788748637.853344:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748637.855942:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358267648 00000100:00100000:0.0:1788748637.855964:0:18866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358267648 00000100:00100000:0.0:1788748637.856144:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:0.0:1788748637.856157:0:18866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4430730-ba8d-423d-b041-116ce5a3d089+18:17394:x1875638358267648:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788748637.857079:0:18866:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788748637.857210:0:18866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901918 00010000:00010000:0.0:1788748637.857270:0:18866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030a00/0x5b377f42a7a7dd25 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.857291:0:18866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030a00/0x5b377f42a7a7dd25 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.857306:0:18866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030a00/0x5b377f42a7a7dd25 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.857317:0:18866:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030a00/0x5b377f42a7a7dd25 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.857325:0:18866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030a00/0x5b377f42a7a7dd25 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.857339:0:18866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030a00/0x5b377f42a7a7dd25 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.857368:0:18866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788748637.857510:0:18866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4430730-ba8d-423d-b041-116ce5a3d089+20:17394:x1875638358267648:12345-192.168.203.4@tcp:35:lhsmtool_posix.0 Request processed in 1351us (4175us total) trans 12884901919 rc 0/0 00000100:00100000:0.0:1788748637.857519:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00000020:00080000:0.0:1788748637.857526:0:18866:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788748637.858575:0:20345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748637.858587:0:20345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030a00/0x5b377f42a7a7dd25 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748637.858629:0:20345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec0030a00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748637.858634:0:20345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030a00/0x5b377f42a7a7dd25 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748637.858646:0:20345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030a00/0x5b377f42a7a7dd25 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748637.858666:0:20345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99cece6d7000) 00010000:00010000:3.0:1788748637.858669:0:20345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788748637.858676:0:20345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030a00/0x5b377f42a7a7dd25 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748637.858682:0:20345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cec0030a00/0x5b377f42a7a7dd25 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748637.858704:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748637.858706:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748637.858708:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748637.903210:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748637.903261:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748637.903306:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748637.903446:0:19553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358267776 00000100:00100000:0.0:1788748637.903460:0:19553:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358267776 00000100:00100000:0.0:1788748637.903529:0:19553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358267904 00000100:00100000:0.0:1788748637.903532:0:19553:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358267904 00000100:00100000:0.0:1788748637.903547:0:19553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358268032 00000100:00100000:0.0:1788748637.903549:0:19553:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358268032 00000100:00100000:0.0:1788748637.903566:0:19553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:0.0:1788748637.903578:0:19553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4430730-ba8d-423d-b041-116ce5a3d089+9:2348:x1875638358267776:12345-192.168.203.4@tcp:4:dd.0 00002000:00010000:0.0:1788748637.903659:0:19553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 0, mtime: 0x6a9e235c, atime: 0x6a9e235b, ctime: 0x6a9e235c, blocks: 0x1 00010000:00010000:0.0:1788748637.903671:0:19553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f609b96/0x5b377f42a7a7dd2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.903691:0:19553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=554s v=(0 0) 00010000:00010000:0.0:1788748637.903696:0:19553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748637.903704:0:19553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f609b96/0x5b377f42a7a7dd2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748637.903721:0:19553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f609b96/0x5b377f42a7a7dd2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788748638.004899:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901891 is committed 00000001:00080000:0.0:1788748638.004923:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00000001:00080000:0.0:1788748638.004940:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901893 is committed 00002000:00010000:1.0:1788748638.006136:0:19553:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:1.0:1788748638.006145:0:19553:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 1788748636 -> 1788748637 00002000:00010000:1.0:1788748638.006148:0:19553:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1788748638.006167:0:19553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f609b96/0x5b377f42a7a7dd2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.006202:0:19553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f609b96/0x5b377f42a7a7dd2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.006212:0:19553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f609b96/0x5b377f42a7a7dd2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.006221:0:19553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec0030a00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748638.006227:0:19553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f609b96/0x5b377f42a7a7dd2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.006238:0:19553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f609b96/0x5b377f42a7a7dd2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.006266:0:19553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f609b96/0x5b377f42a7a7dd2c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.006274:0:19553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f609b96/0x5b377f42a7a7dd2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748638.006615:0:19553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4430730-ba8d-423d-b041-116ce5a3d089+7:2348:x1875638358267776:12345-192.168.203.4@tcp:4:dd.0 Request processed in 103030us (103410us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1788748638.006630:0:19553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:0.0:1788748638.006678:0:19553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:0.0:1788748638.006694:0:19553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef76ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4430730-ba8d-423d-b041-116ce5a3d089+6:2347:x1875638358267904:12345-192.168.203.4@tcp:4:dd.0 00002000:00010000:0.0:1788748638.006750:0:19553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 1048576, mtime: 0x6a9e235d, atime: 0x6a9e235b, ctime: 0x0, blocks: 0x803 00010000:00010000:0.0:1788748638.006757:0:19553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5e41300/0x5b377f42a7a7dd33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748638.006773:0:19553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=555s v=(0 0) 00010000:00010000:0.0:1788748638.006779:0:19553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748638.006787:0:19553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5e41300/0x5b377f42a7a7dd33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748638.006802:0:19553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5e41300/0x5b377f42a7a7dd33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788748638.055688:0:19553:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:1.0:1788748638.055698:0:19553:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 2051 -> 4103 00000001:00080000:2.0:1788748638.055703:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00010000:00010000:1.0:1788748638.055714:0:19553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5e41300/0x5b377f42a7a7dd33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.055728:0:19553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5e41300/0x5b377f42a7a7dd33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.055766:0:19553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5e41300/0x5b377f42a7a7dd33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.055774:0:19553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec0031a00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748638.055778:0:19553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5e41300/0x5b377f42a7a7dd33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.055787:0:19553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5e41300/0x5b377f42a7a7dd33 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.055808:0:19553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5e41300/0x5b377f42a7a7dd33 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.055816:0:19553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5e41300/0x5b377f42a7a7dd33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748638.055898:0:19553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef76ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4430730-ba8d-423d-b041-116ce5a3d089+6:2347:x1875638358267904:12345-192.168.203.4@tcp:4:dd.0 Request processed in 49208us (152633us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1788748638.055909:0:19553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:1.0:1788748638.055955:0:19553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:1.0:1788748638.055967:0:19553:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4430730-ba8d-423d-b041-116ce5a3d089+5:2348:x1875638358268032:12345-192.168.203.4@tcp:4:dd.0 00002000:00010000:1.0:1788748638.056004:0:19553:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 2097152, mtime: 0x6a9e235d, atime: 0x6a9e235b, ctime: 0x0, blocks: 0x1007 00010000:00010000:1.0:1788748638.056011:0:19553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011367eb8/0x5b377f42a7a7dd3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.056067:0:19553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1788748638.056072:0:19553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748638.056078:0:19553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011367eb8/0x5b377f42a7a7dd3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.056089:0:19553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011367eb8/0x5b377f42a7a7dd3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788748638.098508:0:19553:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:1.0:1788748638.098517:0:19553:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:1.0:1788748638.098532:0:19553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011367eb8/0x5b377f42a7a7dd3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.098545:0:19553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011367eb8/0x5b377f42a7a7dd3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.098554:0:19553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011367eb8/0x5b377f42a7a7dd3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.098560:0:19553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748638.098565:0:19553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011367eb8/0x5b377f42a7a7dd3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.098574:0:19553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011367eb8/0x5b377f42a7a7dd3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.098611:0:19553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011367eb8/0x5b377f42a7a7dd3a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.098619:0:19553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011367eb8/0x5b377f42a7a7dd3a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748638.098712:0:19553:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4430730-ba8d-423d-b041-116ce5a3d089+7:2348:x1875638358268032:12345-192.168.203.4@tcp:4:dd.0 Request processed in 42745us (195401us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1788748638.098724:0:19553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2 00000001:00080000:3.0:1788748638.099678:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00000100:00100000:3.0:1788748638.104755:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748638.105307:0:19552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358268160 00000100:00100000:2.0:1788748638.105318:0:19552:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358268160 00000100:00100000:2.0:1788748638.105404:0:19552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:2.0:1788748638.105415:0:19552:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4430730-ba8d-423d-b041-116ce5a3d089+5:2350:x1875638358268160:12345-192.168.203.4@tcp:4:dd.0 00002000:00010000:2.0:1788748638.106249:0:19552:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 3145728, mtime: 0x6a9e235d, atime: 0x6a9e235b, ctime: 0x0, blocks: 0x1807 00010000:00010000:2.0:1788748638.106262:0:19552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb2fc912/0x5b377f42a7a7dd41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748638.106278:0:19552:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=555s v=(0 0) 00010000:00010000:2.0:1788748638.106282:0:19552:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748638.106289:0:19552:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb2fc912/0x5b377f42a7a7dd41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748638.106303:0:19552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb2fc912/0x5b377f42a7a7dd41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748638.113728:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748638.113776:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788748638.113824:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748638.113840:0:19553:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788748638.113851:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748638.113864:0:19553:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1788748638.114311:0:19554:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788748638.114330:0:19554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358268288 00000100:00100000:2.0:1788748638.114340:0:19554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358268288 00000100:00100000:2.0:1788748638.114396:0:19554:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788748638.114402:0:19554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358268416 00000100:00100000:2.0:1788748638.114405:0:19554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358268416 00000100:00100000:2.0:1788748638.114420:0:19554:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788748638.114426:0:19554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358268544 00000100:00100000:2.0:1788748638.114439:0:19554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358268544 00000100:00100000:2.0:1788748638.114456:0:19554:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788748638.114472:0:19554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358268672 00000100:00100000:2.0:1788748638.114476:0:19554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358268672 00000100:00100000:1.0:1788748638.115326:0:20999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:1.0:1788748638.115339:0:20999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4430730-ba8d-423d-b041-116ce5a3d089+10:2349:x1875638358268288:12345-192.168.203.4@tcp:4:dd.0 00010000:00010000:1.0:1788748638.115382:0:20999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011367eb8/0x5b377f42a7a7dd48 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.115401:0:20999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748638.115406:0:20999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748638.115411:0:20999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011367eb8/0x5b377f42a7a7dd48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.115426:0:20999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011367eb8/0x5b377f42a7a7dd48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788748638.178689:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901897 is committed 00002000:00010000:3.0:1788748638.179707:0:19552:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 3145728 -> 5242880 00002000:00010000:3.0:1788748638.179713:0:19552:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:3.0:1788748638.179737:0:19552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb2fc912/0x5b377f42a7a7dd41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748638.179750:0:19552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb2fc912/0x5b377f42a7a7dd41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748638.179759:0:19552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb2fc912/0x5b377f42a7a7dd41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748638.179779:0:19552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc8feb200 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:3.0:1788748638.179784:0:19552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb2fc912/0x5b377f42a7a7dd41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748638.179794:0:19552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb2fc912/0x5b377f42a7a7dd41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748638.179813:0:19552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb2fc912/0x5b377f42a7a7dd41 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748638.179821:0:19552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb2fc912/0x5b377f42a7a7dd41 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748638.179914:0:19552:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4430730-ba8d-423d-b041-116ce5a3d089+12:2350:x1875638358268160:12345-192.168.203.4@tcp:4:dd.0 Request processed in 74497us (75164us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1788748638.179928:0:19552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:3.0:1788748638.179961:0:19552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:3.0:1788748638.179972:0:19552:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cee5196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4430730-ba8d-423d-b041-116ce5a3d089+11:2349:x1875638358268416:12345-192.168.203.4@tcp:4:dd.0 00010000:00010000:3.0:1788748638.180008:0:19552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acea81c7/0x5b377f42a7a7dd4f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748638.180099:0:19552:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748638.180103:0:19552:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748638.180108:0:19552:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acea81c7/0x5b377f42a7a7dd4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748638.180120:0:19552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acea81c7/0x5b377f42a7a7dd4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788748638.224839:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901898 is committed 00002000:00010000:1.0:1788748638.227539:0:20999:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:1.0:1788748638.227561:0:20999:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:1.0:1788748638.227576:0:20999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011367eb8/0x5b377f42a7a7dd48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.227590:0:20999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011367eb8/0x5b377f42a7a7dd48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.227600:0:20999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011367eb8/0x5b377f42a7a7dd48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.227607:0:20999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f9600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748638.227612:0:20999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011367eb8/0x5b377f42a7a7dd48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.227621:0:20999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011367eb8/0x5b377f42a7a7dd48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.227640:0:20999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011367eb8/0x5b377f42a7a7dd48 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.227647:0:20999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011367eb8/0x5b377f42a7a7dd48 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748638.227866:0:20999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4430730-ba8d-423d-b041-116ce5a3d089+11:2349:x1875638358268288:12345-192.168.203.4@tcp:4:dd.0 Request processed in 112525us (114148us total) trans 12884901898 rc 0/0 00000100:00100000:1.0:1788748638.227877:0:20999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:1.0:1788748638.227910:0:20999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:1.0:1788748638.227929:0:20999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefbb4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4430730-ba8d-423d-b041-116ce5a3d089+10:2349:x1875638358268544:12345-192.168.203.4@tcp:4:dd.0 00010000:00010000:1.0:1788748638.227962:0:20999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000687c29e2/0x5b377f42a7a7dd56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.227974:0:20999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748638.227979:0:20999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748638.227985:0:20999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000687c29e2/0x5b377f42a7a7dd56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.227997:0:20999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000687c29e2/0x5b377f42a7a7dd56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788748638.269472:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901899 is committed 00002000:00010000:0.0:1788748638.273654:0:19552:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:0.0:1788748638.273662:0:19552:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:0.0:1788748638.273677:0:19552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acea81c7/0x5b377f42a7a7dd4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748638.273708:0:19552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acea81c7/0x5b377f42a7a7dd4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748638.273717:0:19552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acea81c7/0x5b377f42a7a7dd4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748638.273737:0:19552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceecec2600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748638.273742:0:19552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acea81c7/0x5b377f42a7a7dd4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748638.273752:0:19552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acea81c7/0x5b377f42a7a7dd4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748638.273772:0:19552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acea81c7/0x5b377f42a7a7dd4f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748638.273780:0:19552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acea81c7/0x5b377f42a7a7dd4f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748638.273879:0:19552:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cee5196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4430730-ba8d-423d-b041-116ce5a3d089+10:2349:x1875638358268416:12345-192.168.203.4@tcp:4:dd.0 Request processed in 93905us (160098us total) trans 12884901899 rc 0/0 00000100:00100000:0.0:1788748638.273889:0:19552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:0.0:1788748638.273921:0:19552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:0.0:1788748638.273932:0:19552:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefbb4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4430730-ba8d-423d-b041-116ce5a3d089+9:2349:x1875638358268672:12345-192.168.203.4@tcp:4:dd.0 00010000:00010000:0.0:1788748638.274159:0:19552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f609b96/0x5b377f42a7a7dd5d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748638.274178:0:19552:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748638.274182:0:19552:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748638.274187:0:19552:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f609b96/0x5b377f42a7a7dd5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748638.274199:0:19552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f609b96/0x5b377f42a7a7dd5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788748638.306595:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901900 is committed 00002000:00010000:1.0:1788748638.311309:0:20999:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:1.0:1788748638.311318:0:20999:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 0 -> 1788748637 00002000:00010000:1.0:1788748638.311321:0:20999:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1788748638.311336:0:20999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000687c29e2/0x5b377f42a7a7dd56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.311350:0:20999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000687c29e2/0x5b377f42a7a7dd56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.311359:0:20999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000687c29e2/0x5b377f42a7a7dd56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.311380:0:20999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ceed6f8600 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:1.0:1788748638.311385:0:20999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000687c29e2/0x5b377f42a7a7dd56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.311415:0:20999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000687c29e2/0x5b377f42a7a7dd56 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.311437:0:20999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000687c29e2/0x5b377f42a7a7dd56 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748638.311444:0:20999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000687c29e2/0x5b377f42a7a7dd56 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748638.311545:0:20999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefbb4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4430730-ba8d-423d-b041-116ce5a3d089+9:2349:x1875638358268544:12345-192.168.203.4@tcp:4:dd.0 Request processed in 83616us (197718us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1788748638.311555:0:20999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00010000:00010000:3.0:1788748638.317558:0:18850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788748638.394056:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901901 is committed 00010000:00010000:0.0:1788748638.394467:0:19552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f609b96/0x5b377f42a7a7dd5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748638.394482:0:19552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f609b96/0x5b377f42a7a7dd5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748638.394492:0:19552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f609b96/0x5b377f42a7a7dd5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748638.394499:0:19552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cec0030a00 already unused, calling callback (ffffffffc170b8d0) 00010000:00010000:0.0:1788748638.394504:0:19552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f609b96/0x5b377f42a7a7dd5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748638.394514:0:19552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f609b96/0x5b377f42a7a7dd5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748638.394531:0:19552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f609b96/0x5b377f42a7a7dd5d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748638.394553:0:19552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f609b96/0x5b377f42a7a7dd5d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748638.394685:0:19552:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefbb4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4430730-ba8d-423d-b041-116ce5a3d089+5:2349:x1875638358268672:12345-192.168.203.4@tcp:4:dd.0 Request processed in 120751us (280833us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1788748638.394695:0:19552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:3.0:1788748638.957220:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788748638.957244:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cefbb4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377121792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788748638.957308:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748638.957606:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788748638.957618:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cef7272d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377121920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788748638.957649:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748638.957799:0:19550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377121792 00000100:00100000:0.0:1788748638.957808:0:19550:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377121792 00000100:00100000:0.0:1788748638.957843:0:19550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377121920 00000100:00100000:0.0:1788748638.957845:0:19550:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377121920 00000100:00100000:0.0:1788748638.957880:0:19550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788748638.957889:0:19550:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefbb4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377121792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788748638.957911:0:19550:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3859808256 avail 3849322496 00000100:00100000:0.0:1788748638.957965:0:19550:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefbb4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875638377121792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748638.957972:0:19550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788748638.957988:0:19550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788748638.957995:0:19550:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefb809500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377121920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788748638.958044:0:19550:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788748638.958077:0:19550:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefb809500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875638377121920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748638.958083:0:19550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788748638.958120:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cef7272d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875638377121920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788748638.958192:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901893 gen 2 00000004:00080000:2.0:1788748638.958198:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99cef7270000, transno 12884901891 00000004:00080000:2.0:1788748638.958215:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901893 committed transno 12884901893 00000100:00100000:2.0:1788748638.958237:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cefbb4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875638377121792:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788748638.958287:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788748638.958449:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377122304:0@lo:400:kworker.0 00000100:00100000:1.0:1788748638.958485:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748638.958506:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788748638.958512:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377122176:0@lo:400:kworker.0 00000100:00100000:1.0:1788748638.958532:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748638.958549:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875638377122688:0@lo:400:kworker.0 00000100:00100000:3.0:1788748638.958626:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875638377122432:0@lo:400:kworker.0 00000100:00100000:3.0:1788748638.958657:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748638.958679:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788748638.958684:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ddbae60-91f9-474f-9a47-689ab5e32951:3308:1875638377122048:0@lo:400:kworker.0 00000100:00100000:3.0:1788748638.958707:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748638.958728:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc5c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377122560:0@lo:400:kworker.0 00000100:00100000:3.0:1788748638.958747:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748638.958802:0:20347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377122304 00000100:00100000:3.0:1788748638.958807:0:20347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377122304 00000100:00100000:3.0:1788748638.958835:0:20347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377122176 00000100:00100000:3.0:1788748638.958837:0:20347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377122176 00000100:00100000:3.0:1788748638.958851:0:20347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788748638.958858:0:20347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377122304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748638.958891:0:20347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377122304:12345-0@lo:400:kworker.0 Request processed in 33us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748638.958897:0:20347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788748638.958911:0:20347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788748638.958917:0:20347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377122176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748638.958941:0:20347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875638377122176:12345-0@lo:400:kworker.0 Request processed in 25us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748638.958947:0:20347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788748638.958975:0:18864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377122432 00000100:00100000:3.0:1788748638.958979:0:18864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377122432 00000100:00100000:3.0:1788748638.959005:0:18864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377122560 00000100:00100000:3.0:1788748638.959008:0:18864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377122560 00000100:00100000:3.0:1788748638.959050:0:18864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788748638.959056:0:18864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefbb4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875638377122432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748638.959088:0:18864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefbb4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875638377122432:12345-0@lo:400:kworker.0 Request processed in 33us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748638.959094:0:18864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788748638.959105:0:18864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788748638.959111:0:18864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cefbb4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377122560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748638.959134:0:18864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cefbb4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875638377122560:12345-0@lo:400:kworker.0 Request processed in 24us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748638.959139:0:18864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1788748638.959160:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748638.959179:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875638377122560:0@lo:400:kworker.0 00000100:00100000:3.0:1788748638.959188:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875638377122432:0@lo:400:kworker.0 00000100:00100000:2.0:1788748638.959304:0:18854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377122048 00000100:00100000:2.0:1788748638.959308:0:18854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377122048 00000100:00100000:2.0:1788748638.959331:0:18854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788748638.959337:0:18854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecf9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+19:3308:x1875638377122048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748638.959388:0:18854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecf9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ddbae60-91f9-474f-9a47-689ab5e32951+19:3308:x1875638377122048:12345-0@lo:400:kworker.0 Request processed in 51us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748638.959394:0:18854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788748638.959425:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ddbae60-91f9-474f-9a47-689ab5e32951:3308:1875638377122048:0@lo:400:kworker.0 00000100:00100000:1.0:1788748638.959736:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748638.959769:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377122304:0@lo:400:kworker.0 00000100:00100000:1.0:1788748638.959791:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875638377122176:0@lo:400:kworker.0 00000100:00100000:0.0:1788748638.960308:0:19570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638377122688 00000100:00100000:0.0:1788748638.960320:0:19570:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638377122688 00000100:00100000:0.0:1788748638.960710:0:19570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788748638.960719:0:19570:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875638377122688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748638.960771:0:19570:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875638377122688:12345-0@lo:400:kworker.0 Request processed in 53us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748638.960778:0:19570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788748638.960913:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748638.960939:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99cdc5c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875638377122688:0@lo:400:kworker.0 00000100:00100000:0.0:1788748639.269682:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748639.269723:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748639.269874:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748639.269899:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748639.269947:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358268800 00000100:00100000:1.0:1788748639.269959:0:18857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358268800 00000100:00100000:1.0:1788748639.270006:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 121 00000100:00100000:0.0:1788748639.270042:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788748639.270045:0:18857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ceecf9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:745dd5eb-2b80-4752-9076-ef21465f0c36+13:2349:x1875638358268800:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748639.270063:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788748639.270099:0:20940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358269056 00000100:00100000:2.0:1788748639.270104:0:20940:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358269056 00000100:00100000:1.0:1788748639.270113:0:18857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ceecf9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:745dd5eb-2b80-4752-9076-ef21465f0c36+13:2349:x1875638358268800:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 99us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748639.270120:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 121 00000100:00100000:2.0:1788748639.270142:0:20940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358269568 00000100:00100000:2.0:1788748639.270145:0:20940:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358269568 00000100:00100000:2.0:1788748639.270192:0:20940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:2.0:1788748639.270201:0:20940:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4430730-ba8d-423d-b041-116ce5a3d089+5:2349:x1875638358269056:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788748639.270205:0:19547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:1.0:1788748639.270212:0:19547:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7270e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd074acc-e2d0-4043-bc1b-1aea376ea903+5:2349:x1875638358269568:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748639.270230:0:20940:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4430730-ba8d-423d-b041-116ce5a3d089+5:2349:x1875638358269056:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 32us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748639.270231:0:19547:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7270e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd074acc-e2d0-4043-bc1b-1aea376ea903+5:2349:x1875638358269568:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 20us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748639.270236:0:20940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00080000:2.0:1788748639.270258:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788748639.270268:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788748639.270508:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788748639.270603:0:18862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358269312 00000100:00100000:0.0:1788748639.270607:0:18862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358269312 00000100:00100000:0.0:1788748639.270643:0:18862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358268928 00000100:00100000:0.0:1788748639.270646:0:18862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358268928 00000100:00100000:0.0:1788748639.270669:0:18862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:0.0:1788748639.270676:0:18862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd074acc-e2d0-4043-bc1b-1aea376ea903+6:2349:x1875638358269312:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748639.270719:0:18862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd074acc-e2d0-4043-bc1b-1aea376ea903+6:2349:x1875638358269312:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 42us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748639.270726:0:18862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:2.0:1788748639.270878:0:19548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358269184 00000100:00100000:2.0:1788748639.270884:0:19548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358269184 00000100:00100000:0.0:1788748639.270916:0:18862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:0.0:1788748639.270924:0:18862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4430730-ba8d-423d-b041-116ce5a3d089+20:2349:x1875638358268928:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788748639.270958:0:18862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4430730-ba8d-423d-b041-116ce5a3d089+20:2349:x1875638358268928:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 35us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748639.270965:0:18862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00080000:0.0:1788748639.271053:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788748639.271057:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748639.271890:0:19547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:2.0:1788748639.271938:0:19548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638358269440 00000100:00100000:2.0:1788748639.271943:0:19548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638358269440 00000100:00100000:2.0:1788748639.271982:0:19548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:2.0:1788748639.271991:0:19548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7270a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4430730-ba8d-423d-b041-116ce5a3d089+5:2349:x1875638358269184:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748639.272060:0:19548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7270a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4430730-ba8d-423d-b041-116ce5a3d089+5:2349:x1875638358269184:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 71us (1996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748639.272067:0:19548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:2.0:1788748639.272080:0:19548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:2.0:1788748639.272086:0:19548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99cef7272680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd074acc-e2d0-4043-bc1b-1aea376ea903+5:2349:x1875638358269440:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788748639.272105:0:19548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99cef7272680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd074acc-e2d0-4043-bc1b-1aea376ea903+5:2349:x1875638358269440:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 20us (1599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748639.272111:0:19548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00080000:0.0:1788748639.272394:0:18858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788748639.342092:0:18851:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788748639.634443:0:21037:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1788748640.368886:0:20345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 9545 lines, 9545 kept, 0 dropped, 0 bad.