00010000:00010000:1.0F:1788836408.019445:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0F:1788836408.760338:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934615 is committed 00000001:00080000:3.0:1788836408.760408:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:3.0:1788836408.760419:0:5851:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bd07980c9c0 refcount 2 committed 0 result 0 batchid 4294967527 00000020:00080000:3.0:1788836408.760423:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd048b76f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bd07980c180 00000020:00080000:3.0:1788836408.760427:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd048b76900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bd0516b0400 00000020:00080000:0.0F:1788836408.761038:0:14341:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967527 committed batchid 8 00000020:00080000:0.0:1788836408.761303:0:14341:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1788836409.041234:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0F:1788836410.064554:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836410.458236:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836410.458272:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518636032 00000100:00100000:2.0:1788836410.458281:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518636032 00000100:00100000:2.0:1788836410.458373:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:2.0:1788836410.458384:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+12:14431:x1875730518636032:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788836410.458478:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+12:14431:x1875730518636032:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 Request processed in 96us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836410.458486:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00080000:0.0:1788836410.461535:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836410.474445:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836410.474479:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518636288 00000100:00100000:2.0:1788836410.474488:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518636288 00000100:00100000:2.0:1788836410.474540:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:2.0:1788836410.474549:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+12:14431:x1875730518636288:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788836410.475069:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+13:14431:x1875730518636288:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 518us (630us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1788836410.475077:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00010000:00010000:1.0:1788836411.088800:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836411.728748:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538537728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836411.728816:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836411.728917:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538537728 00000100:00100000:3.0:1788836411.728925:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538537728 00000100:00100000:3.0:1788836411.728978:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788836411.728988:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538537728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788836411.729089:0:14990:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788836411.729140:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538537728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836411.729150:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788836411.729170:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538537984:0@lo:400:kworker.0 00000100:00100000:3.0:1788836411.729182:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538538240:0@lo:400:kworker.0 00000100:00100000:1.0:1788836411.729210:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836411.729221:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836411.729259:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836411.729267:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538538112:0@lo:400:kworker.0 00000100:00100000:3.0:1788836411.729282:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538537728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788836411.729293:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836411.729303:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788836411.729311:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8cc5c45-b703-4cf0-83fd-6722cde04691:3304:1875730538537856:0@lo:400:kworker.0 00000100:00100000:3.0:1788836411.729368:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836411.729369:0:16587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538538240 00000100:00100000:1.0:1788836411.729374:0:16587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538538240 00000100:00100000:1.0:1788836411.729406:0:16587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538538112 00000100:00100000:1.0:1788836411.729409:0:16587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538538112 00000100:00100000:3.0:1788836411.729418:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07accb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875730538538368:0@lo:400:kworker.0 00000100:00100000:1.0:1788836411.729430:0:16587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788836411.729438:0:16587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538538240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836411.729446:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836411.729471:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538537856 00000100:00100000:3.0:1788836411.729475:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538537856 00000100:00100000:1.0:1788836411.729488:0:16587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538538240:12345-0@lo:400:kworker.0 Request processed in 50us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836411.729495:0:16587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788836411.729508:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788836411.729512:0:16587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538538368 00000100:00100000:1.0:1788836411.729516:0:16587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538538368 00000100:00100000:3.0:1788836411.729532:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:3304:x1875730538537856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836411.729538:0:16587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788836411.729547:0:16587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07accb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538538112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836411.729569:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:3304:x1875730538537856:12345-0@lo:400:kworker.0 Request processed in 40us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836411.729576:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788836411.729592:0:16587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07accb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538538112:12345-0@lo:400:kworker.0 Request processed in 46us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836411.729599:0:16587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788836411.729617:0:16587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788836411.729624:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8cc5c45-b703-4cf0-83fd-6722cde04691:3304:1875730538537856:0@lo:400:kworker.0 00000100:00100000:1.0:1788836411.729627:0:16587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875730538538368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836411.729643:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538538240:0@lo:400:kworker.0 00000100:00100000:1.0:1788836411.729665:0:16587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875730538538368:12345-0@lo:400:kworker.0 Request processed in 41us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836411.729670:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07accb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875730538538368:0@lo:400:kworker.0 00000100:00100000:1.0:1788836411.729676:0:16587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788836411.729715:0:16287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538537984 00000100:00100000:1.0:1788836411.729719:0:16287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538537984 00000100:00100000:1.0:1788836411.729754:0:16287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788836411.729761:0:16287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538537984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836411.729794:0:16287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538537984:12345-0@lo:400:kworker.0 Request processed in 34us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836411.729800:0:16287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788836411.729828:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538538112:0@lo:400:kworker.0 00000100:00100000:1.0:1788836411.729838:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538537984:0@lo:400:kworker.0 00000100:00080000:0.0:1788836411.729925:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788836411.729930:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788836411.729932:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788836412.112822:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836412.247575:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788836412.248428:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538538496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836412.248533:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836412.248619:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538538496 00000100:00100000:1.0:1788836412.248631:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538538496 00000100:00100000:3.0:1788836412.248790:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788836412.248805:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079796d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538538496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788836412.248850:0:14990:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788836412.248923:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079796d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538538496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836412.248932:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788836412.249012:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538538496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836412.626289:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836412.629480:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836412.629537:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836412.629582:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836412.629679:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518636416 00000100:00100000:1.0:1788836412.629692:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518636416 00000100:00100000:1.0:1788836412.629763:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 124 00000100:00100000:1.0:1788836412.629775:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33da8487-9547-4be0-bbdf-a73d9371b5ba+13:2356:x1875730518636416:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788836412.629870:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33da8487-9547-4be0-bbdf-a73d9371b5ba+13:2356:x1875730518636416:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 96us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836412.629879:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 124 00000100:00100000:3.0:1788836412.631718:0:16587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518636544 00000100:00100000:3.0:1788836412.631737:0:16587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518636544 00000100:00100000:3.0:1788836412.631846:0:16587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:3.0:1788836412.631859:0:16587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+13:2356:x1875730518636544:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836412.631975:0:16587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+13:2356:x1875730518636544:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 119us (2438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836412.631982:0:16587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00080000:1.0:1788836412.632739:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836412.635995:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836412.636037:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836412.636106:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518636928 00000100:00100000:3.0:1788836412.636120:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518636928 00000100:00100000:3.0:1788836412.636198:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:3.0:1788836412.636210:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03b72b3e-8a8e-455d-8604-5896fa644ca9+6:2356:x1875730518636928:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836412.636324:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03b72b3e-8a8e-455d-8604-5896fa644ca9+6:2356:x1875730518636928:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 116us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836412.636333:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:0.0:1788836412.637573:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518636672 00000100:00100000:0.0:1788836412.637590:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518636672 00000100:00100000:0.0:1788836412.637694:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518636800 00000100:00100000:0.0:1788836412.637699:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518636800 00000100:00100000:0.0:1788836412.637732:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:0.0:1788836412.637745:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079796300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+5:2356:x1875730518636800:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836412.637829:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079796300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+5:2356:x1875730518636800:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 89us (8246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836412.637838:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:0.0:1788836412.637859:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:0.0:1788836412.637866:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+5:2352:x1875730518636672:12345-192.168.203.52@tcp:9:kworker.0 00000020:00000080:0.0:1788836412.637891:0:14985:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a6d9 00000100:00080000:0.0:1788836412.637922:0:14985:0:(import.c:65:import_set_state_nolock()) ffff9bd07985c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788836412.637976:0:14985:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00010000:00010000:3.0:1788836412.638535:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788836412.638560:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788836412.638564:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788836412.638567:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836412.639085:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+2:2352:x1875730518636672:12345-192.168.203.52@tcp:9:kworker.0 Request processed in 1213us (12888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836412.639096:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:2.0:1788836412.640753:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836412.640982:0:16287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518637056 00000100:00100000:3.0:1788836412.640994:0:16287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518637056 00000100:00100000:3.0:1788836412.641062:0:16287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518637184 00000100:00100000:3.0:1788836412.641065:0:16287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518637184 00000100:00100000:3.0:1788836412.641085:0:16287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:3.0:1788836412.641094:0:16287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03b72b3e-8a8e-455d-8604-5896fa644ca9+5:2352:x1875730518637056:12345-192.168.203.52@tcp:9:kworker.0 00000020:00000080:3.0:1788836412.641142:0:16287:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a711 00000100:00080000:3.0:1788836412.641154:0:16287:0:(import.c:65:import_set_state_nolock()) ffff9bd04ebfd000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788836412.641199:0:16287:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1788836412.641466:0:16287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03b72b3e-8a8e-455d-8604-5896fa644ca9+2:2352:x1875730518637056:12345-192.168.203.52@tcp:9:kworker.0 Request processed in 371us (5427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836412.641475:0:16287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:3.0:1788836412.641492:0:16287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:3.0:1788836412.641499:0:16287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03b72b3e-8a8e-455d-8604-5896fa644ca9+5:2352:x1875730518637184:12345-192.168.203.52@tcp:9:kworker.0 00000020:00000080:3.0:1788836412.641512:0:16287:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a718 00000100:00080000:3.0:1788836412.641520:0:16287:0:(import.c:65:import_set_state_nolock()) ffff9bd047f4e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788836412.641540:0:16287:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:3.0:1788836412.641745:0:16287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03b72b3e-8a8e-455d-8604-5896fa644ca9+2:2352:x1875730518637184:12345-192.168.203.52@tcp:9:kworker.0 Request processed in 245us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836412.641753:0:16287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00010000:00010000:3.0:1788836412.642161:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836412.642256:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788836412.642480:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788836412.642486:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788836413.140055:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788836413.827389:0:5851:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967527 batchid updated 00000001:00080000:3.0:1788836413.827423:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:1.0:1788836413.827499:0:14341:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000020:00080000:1.0:1788836413.827510:0:14341:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000040:00080000:3.0:1788836413.845141:0:14336:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788836413.845148:0:14336:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788836413.845177:0:14336:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788836413.845183:0:14336:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788836414.163207:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788836414.848985:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 03b72b3e-8a8e-455d-8604-5896fa644ca9 00000020:00000080:3.0:1788836414.848994:0:7628:0:(genops.c:885:class_export_put()) final put ffff9bd04ebfc800/03b72b3e-8a8e-455d-8604-5896fa644ca9 00000020:00000080:0.0:1788836414.849133:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd04ebfc800/03b72b3e-8a8e-455d-8604-5896fa644ca9 for lustre-OST0001 00000020:00000080:0.0:1788836414.851384:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd047f4e000 for lustre-OST0001 00010000:00010000:0.0:1788836415.189761:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836416.212497:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836416.848623:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538539008:0@lo:400:kworker.0 00000100:00100000:1.0:1788836416.848703:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836416.848766:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788836416.848772:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8cc5c45-b703-4cf0-83fd-6722cde04691:3302:1875730538538624:0@lo:400:kworker.0 00000100:00100000:1.0:1788836416.848812:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836416.849038:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07accad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538539136:0@lo:400:kworker.0 00000100:00100000:1.0:1788836416.849065:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836416.849141:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538538880:0@lo:400:kworker.0 00000100:00100000:1.0:1788836416.851547:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836416.851614:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788836416.851629:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538538752:0@lo:400:kworker.0 00000100:00100000:1.0:1788836416.851685:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836416.851709:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875730538539264:0@lo:400:kworker.0 00000100:00100000:1.0:1788836416.851738:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836416.861279:0:16287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538538880 00000100:00100000:2.0:1788836416.861293:0:16287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538538880 00000100:00100000:1.0:1788836416.861530:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538538624 00000100:00100000:1.0:1788836416.861534:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538538624 00000100:00100000:1.0:1788836416.861569:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788836416.861579:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44af2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:3302:x1875730538538624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836416.861657:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44af2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:3302:x1875730538538624:12345-0@lo:400:kworker.0 Request processed in 80us (12843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836416.861665:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788836416.861698:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538538752 00000100:00100000:1.0:1788836416.861703:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538538752 00000100:00100000:1.0:1788836416.861731:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788836416.861736:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07accb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538538880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836416.861770:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07accb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538538880:12345-0@lo:400:kworker.0 Request processed in 33us (12602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836416.861775:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788836416.861786:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788836416.861792:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538538752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836416.861968:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538538752:12345-0@lo:400:kworker.0 Request processed in 175us (10283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836416.861975:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788836416.862017:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8cc5c45-b703-4cf0-83fd-6722cde04691:3302:1875730538538624:0@lo:400:kworker.0 00000100:00100000:1.0:1788836416.862049:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538538880:0@lo:400:kworker.0 00000100:00100000:1.0:1788836416.862067:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538539392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788836416.862098:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836416.862125:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538538752:0@lo:400:kworker.0 00000100:00080000:2.0:1788836416.862263:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788836416.862267:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788836416.867576:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538539008 00000100:00100000:0.0:1788836416.867589:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538539008 00000100:00100000:0.0:1788836416.867648:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538539136 00000100:00100000:0.0:1788836416.867651:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538539136 00000100:00080000:0.0:1788836416.867671:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836416.867686:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538539264 00000100:00100000:0.0:1788836416.867688:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538539264 00000100:00080000:0.0:1788836416.867699:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836416.867716:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788836416.867725:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538539008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836416.867900:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538539008:12345-0@lo:400:kworker.0 Request processed in 175us (19196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836416.867907:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788836416.867951:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538539008:0@lo:400:kworker.0 00000100:00100000:0.0:1788836416.867974:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788836416.867981:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538539136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836416.868014:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538539136:12345-0@lo:400:kworker.0 Request processed in 34us (18948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836416.868020:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788836416.868042:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07accad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538539136:0@lo:400:kworker.0 00000100:00100000:0.0:1788836416.868062:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788836416.868069:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07accbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875730538539264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836416.868192:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07accbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875730538539264:12345-0@lo:400:kworker.0 Request processed in 123us (16452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836416.868199:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788836416.868229:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875730538539264:0@lo:400:kworker.0 00000100:00100000:3.0:1788836416.872609:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538539392 00000100:00100000:3.0:1788836416.872624:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538539392 00000100:00100000:3.0:1788836416.873884:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788836416.873896:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538539392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788836416.873934:0:14990:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 68091904 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788836416.874016:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538539392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (11917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836416.874023:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788836416.874083:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538539392:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788836416.964394:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d 00000020:00000080:1.0:1788836416.964401:0:6708:0:(genops.c:885:class_export_put()) final put ffff9bd07985b000/7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d 00000001:00100000:1.0:1788836416.964556:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 03b72b3e-8a8e-455d-8604-5896fa644ca9 00000020:00000080:1.0:1788836416.964559:0:6708:0:(genops.c:885:class_export_put()) final put ffff9bd079848000/03b72b3e-8a8e-455d-8604-5896fa644ca9 00000020:00000080:1.0:1788836416.964574:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07985b000/7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d for lustre-OST0000 00000020:00000080:1.0:1788836416.964612:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd079848000/03b72b3e-8a8e-455d-8604-5896fa644ca9 for lustre-OST0000 00000020:00000080:1.0:1788836416.964755:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd07985c000 for lustre-OST0000 00000020:00000080:1.0:1788836416.964762:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd04ebfd000 for lustre-OST0000 00010000:00010000:1.0:1788836417.239426:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836417.366268:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788836417.366288:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538539520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836417.366368:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836417.366418:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538539520 00000100:00100000:3.0:1788836417.366424:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538539520 00000100:00100000:3.0:1788836417.366459:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788836417.366466:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538539520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788836417.366497:0:14990:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788836417.366545:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538539520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836417.366552:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788836417.366590:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538539520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836417.739963:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836417.740009:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836417.740048:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836417.740121:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836417.740153:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518637440 00000100:00100000:2.0:1788836417.740163:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518637440 00000100:00100000:2.0:1788836417.740216:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518637696 00000100:00100000:2.0:1788836417.740220:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518637696 00000100:00100000:2.0:1788836417.740246:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:2.0:1788836417.740257:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+12:2354:x1875730518637440:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836417.740331:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+12:2354:x1875730518637440:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 75us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836417.740338:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:2.0:1788836417.740373:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:2.0:1788836417.740381:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03b72b3e-8a8e-455d-8604-5896fa644ca9+6:2354:x1875730518637696:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836417.740404:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03b72b3e-8a8e-455d-8604-5896fa644ca9+6:2354:x1875730518637696:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 25us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836417.740410:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00080000:2.0:1788836417.740427:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836417.742375:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518637312 00000100:00100000:1.0:1788836417.742389:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518637312 00000100:00100000:1.0:1788836417.742449:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 126 00000100:00100000:1.0:1788836417.742460:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+13:2354:x1875730518637312:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788836417.742539:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+13:2354:x1875730518637312:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 82us (2585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836417.742623:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 126 00000100:00100000:1.0:1788836417.742676:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518637568 00000100:00100000:1.0:1788836417.742680:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518637568 00000100:00100000:1.0:1788836417.742735:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:1.0:1788836417.742743:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+5:2354:x1875730518637568:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788836417.742779:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+5:2354:x1875730518637568:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 37us (2729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836417.742785:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00080000:2.0:1788836417.742917:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788836418.256535:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836419.280817:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836420.308221:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788836420.364647:0:17246:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 23:00:17 (1788836417) 00010000:00010000:1.0:1788836421.329229:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836421.975251:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788836421.975276:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538539648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836421.975378:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836421.977006:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538539648 00000100:00100000:3.0:1788836421.977016:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538539648 00000100:00100000:3.0:1788836421.977077:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788836421.977086:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538539648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788836421.977119:0:14990:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 68091904 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788836421.977193:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538539648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (1815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836421.977200:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788836421.977259:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8cc5c45-b703-4cf0-83fd-6722cde04691:3304:1875730538539776:0@lo:400:kworker.0 00000100:00100000:3.0:1788836421.977294:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836421.977337:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538539776 00000100:00100000:3.0:1788836421.977360:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538539776 00000100:00100000:3.0:1788836421.977385:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788836421.977390:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:3304:x1875730538539776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836421.977422:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:3304:x1875730538539776:12345-0@lo:400:kworker.0 Request processed in 31us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836421.977428:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788836421.977466:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8cc5c45-b703-4cf0-83fd-6722cde04691:3304:1875730538539776:0@lo:400:kworker.0 00000100:00100000:3.0:1788836421.977497:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538539904:0@lo:400:kworker.0 00000100:00100000:3.0:1788836421.977537:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836421.977566:0:16287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538539904 00000100:00100000:3.0:1788836421.977570:0:16287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538539904 00000100:00100000:3.0:1788836421.977597:0:16287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788836421.977604:0:16287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd048040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538539904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836421.977639:0:16287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd048040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538539904:12345-0@lo:400:kworker.0 Request processed in 36us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836421.977645:0:16287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788836421.978866:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788836421.978871:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788836421.979049:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538539648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836421.980404:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538539904:0@lo:400:kworker.0 00000100:00100000:3.0:1788836421.980463:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788836421.980474:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875730538540032:0@lo:400:kworker.0 00000100:00100000:3.0:1788836421.980527:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836421.980567:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538540032 00000100:00100000:3.0:1788836421.980573:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538540032 00000100:00100000:3.0:1788836421.980610:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788836421.980618:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875730538540032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836421.980662:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875730538540032:12345-0@lo:400:kworker.0 Request processed in 45us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836421.980669:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788836421.985259:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875730538540032:0@lo:400:kworker.0 00000100:00100000:3.0:1788836421.985375:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875730538540288:0@lo:400:kworker.0 00000100:00100000:3.0:1788836421.985433:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836421.985828:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788836421.985848:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538540160:0@lo:400:kworker.0 00000100:00100000:0.0:1788836421.985883:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836421.987113:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538540288 00000100:00100000:3.0:1788836421.987125:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538540288 00000100:00100000:2.0:1788836421.987419:0:16587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538540160 00000100:00100000:2.0:1788836421.987434:0:16587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538540160 00000100:00100000:2.0:1788836421.987493:0:16587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788836421.987505:0:16587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538540160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836421.987580:0:16587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538540160:12345-0@lo:400:kworker.0 Request processed in 78us (1696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836421.987588:0:16587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1788836421.987619:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836421.987657:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538540160:0@lo:400:kworker.0 00000100:00100000:3.0:1788836421.987939:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788836421.987948:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875730538540288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836421.987996:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875730538540288:12345-0@lo:400:kworker.0 Request processed in 49us (2562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836421.988003:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788836421.988034:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875730538540288:0@lo:400:kworker.0 00000100:00080000:2.0:1788836421.989580:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788836422.355450:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836422.483501:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788836422.486013:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538540416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836422.486089:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836422.486793:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538540416 00000100:00100000:0.0:1788836422.486802:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538540416 00000100:00100000:0.0:1788836422.486904:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788836422.486914:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538540416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788836422.486949:0:14990:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788836422.487005:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538540416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836422.487012:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788836422.487098:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538540416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836422.856997:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836422.857041:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836422.857082:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836422.857101:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518638080 00000100:00100000:3.0:1788836422.857111:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518638080 00000100:00100000:2.0:1788836422.857130:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00080000:2.0:1788836422.857174:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788836422.857185:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:3.0:1788836422.857198:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+5:2356:x1875730518638080:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836422.857198:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518637952 00000100:00100000:2.0:1788836422.857204:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518637952 00000100:00100000:2.0:1788836422.857251:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518638208 00000100:00100000:2.0:1788836422.857255:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518638208 00000100:00100000:2.0:1788836422.857278:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:2.0:1788836422.857286:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+12:2356:x1875730518637952:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836422.857295:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+5:2356:x1875730518638080:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 99us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836422.857315:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:2.0:1788836422.857320:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+12:2356:x1875730518637952:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 33us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836422.857329:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:1.0:1788836422.857498:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518637824 00000100:00100000:1.0:1788836422.857501:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518637824 00000100:00100000:1.0:1788836422.857530:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 128 00000100:00100000:1.0:1788836422.857538:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079317050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+13:2356:x1875730518637824:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788836422.857568:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079317050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+13:2356:x1875730518637824:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 32us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836422.857574:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 128 00000100:00100000:3.0:1788836422.860464:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:3.0:1788836422.860484:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03b72b3e-8a8e-455d-8604-5896fa644ca9+6:2356:x1875730518638208:12345-192.168.203.52@tcp:400:kworker.0 00000100:00080000:2.0:1788836422.860551:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836422.860578:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03b72b3e-8a8e-455d-8604-5896fa644ca9+6:2356:x1875730518638208:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 101us (3447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836422.860764:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 43 00000040:00080000:3.0:1788836423.056635:0:14336:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788836423.056643:0:14336:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788836423.056679:0:14336:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788836423.056685:0:14336:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788836423.378733:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836424.400811:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836424.578417:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836424.578632:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518638464 00000100:00100000:0.0:1788836424.578641:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518638464 00000100:00100000:0.0:1788836424.578732:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:0.0:1788836424.578743:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+12:15313:x1875730518638464:12345-192.168.203.52@tcp:35:umount.0 00000001:00080000:0.0:1788836424.579049:0:14307:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1788836424.579145:0:14307:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:0.0:1788836424.579283:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+15:15313:x1875730518638464:12345-192.168.203.52@tcp:35:umount.0 Request processed in 542us (874us total) trans 8589934626 rc 0/0 00000100:00100000:0.0:1788836424.579292:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000020:00080000:0.0:1788836424.579303:0:14307:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00080000:2.0:1788836424.579635:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836424.585387:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836424.585476:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836424.592380:0:16533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518638592 00000100:00100000:2.0:1788836424.592394:0:16533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518638592 00000100:00100000:2.0:1788836424.592502:0:16533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518638720 00000100:00100000:2.0:1788836424.592506:0:16533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518638720 00000100:00100000:1.0:1788836424.597475:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:1.0:1788836424.597503:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a358380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33da8487-9547-4be0-bbdf-a73d9371b5ba+14:2356:x1875730518638592:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836424.597521:0:14290:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836424.597542:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd047999a00/0xcb5b7bc40b90a6bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aac3 expref: 14 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836424.597559:0:14290:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836424.597633:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a358380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33da8487-9547-4be0-bbdf-a73d9371b5ba+13:2356:x1875730518638592:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 145us (12255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836424.597654:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:1.0:1788836424.597680:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:1.0:1788836424.597687:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07945fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33da8487-9547-4be0-bbdf-a73d9371b5ba+12:2356:x1875730518638720:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836424.600542:0:14290:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836424.600572:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd07978bc00/0xcb5b7bc40b90a6c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aaed expref: 12 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836424.600588:0:14290:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836424.600652:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07945fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33da8487-9547-4be0-bbdf-a73d9371b5ba+11:2356:x1875730518638720:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 2963us (15175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836424.600662:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:0.0:1788836424.600684:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836424.600753:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836424.600817:0:16287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518638976 00000100:00100000:3.0:1788836424.600832:0:16287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518638976 00000100:00100000:1.0:1788836424.600859:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518638848 00000100:00100000:1.0:1788836424.600865:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518638848 00000100:00100000:3.0:1788836424.600894:0:16287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:1.0:1788836424.600905:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:3.0:1788836424.600907:0:16287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+5:2352:x1875730518638976:12345-192.168.203.52@tcp:9:umount.0 00000100:00100000:1.0:1788836424.600918:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33da8487-9547-4be0-bbdf-a73d9371b5ba+11:2355:x1875730518638848:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836424.600930:0:14290:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836424.600942:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b90a73b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab8e expref: 11 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788836424.600953:0:16287:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a6e0 00010000:00010000:1.0:1788836424.600954:0:14290:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:3.0:1788836424.600965:0:16287:0:(import.c:65:import_set_state_nolock()) ffff9bd07985e000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788836424.600987:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33da8487-9547-4be0-bbdf-a73d9371b5ba+10:2355:x1875730518638848:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 72us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836424.600994:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000001:00000004:3.0:1788836424.601000:0:16287:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934605 00010000:00010000:1.0:1788836424.601052:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836424.601230:0:16287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+2:2352:x1875730518638976:12345-192.168.203.52@tcp:9:umount.0 Request processed in 326us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836424.601237:0:16287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00080000:0.0:1788836424.601455:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788836424.630224:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836424.630441:0:16587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518639872 00000100:00100000:0.0:1788836424.630450:0:16587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518639872 00000100:00100000:0.0:1788836424.630507:0:16587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:0.0:1788836424.630518:0:16587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+15:2352:x1875730518639872:12345-192.168.203.52@tcp:39:umount.0 00000020:00000080:0.0:1788836424.630548:0:16587:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a6d2 00000020:00010000:0.0:1788836424.630563:0:16587:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9bcf46074800: total 0 00000100:00080000:0.0:1788836424.630568:0:16587:0:(import.c:65:import_set_state_nolock()) ffff9bd05274f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788836424.630600:0:16587:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:0.0:1788836424.630946:0:16587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+14:2352:x1875730518639872:12345-192.168.203.52@tcp:39:umount.0 Request processed in 429us (730us total) trans 8589934627 rc 0/0 00000100:00100000:0.0:1788836424.630954:0:16587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 55 00000020:00010000:1.0:1788836424.631147:0:14292:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9bcf46074800: total 0 00010000:00010000:1.0:1788836424.631163:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836424.631197:0:14292:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bcf46074800, canceled 0 locks, left on hash table 7. 00010000:00010000:1.0:1788836424.631223:0:14292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bd04940be00) 00010000:00010000:1.0:1788836424.631226:0:14292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788836424.631232:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2600/0xcb5b7bc40b90a781 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab95 expref: 13 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836424.631253:0:14292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bd04940b500) 00010000:00010000:1.0:1788836424.631256:0:14292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788836424.631260:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b90a85a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abd4 expref: 12 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836424.631276:0:14292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd04506a200) 00010000:00010000:1.0:1788836424.631278:0:14292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788836424.631281:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b90a956 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac21 expref: 11 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836424.631295:0:14292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd04506a700) 00010000:00010000:1.0:1788836424.631309:0:14292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788836424.631313:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030400/0xcb5b7bc40b90a8d8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abfe expref: 10 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836424.631326:0:14292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940b400) 00010000:00010000:1.0:1788836424.631328:0:14292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788836424.631332:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2a00/0xcb5b7bc40b90a7d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abaa expref: 9 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836424.631384:0:14292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd04506a700) 00010000:00010000:1.0:1788836424.631387:0:14292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788836424.631397:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031800/0xcb5b7bc40b90a8fb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac0c expref: 8 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836424.631413:0:14292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd04940b000) 00010000:00010000:1.0:1788836424.631415:0:14292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836424.631419:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2000/0xcb5b7bc40b90a79d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab9c expref: 7 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836424.631430:0:14292:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bcf46074800, canceled 7 locks, left on hash table 0. 00010000:00010000:1.0:1788836424.631441:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836424.631443:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836424.631445:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788836425.077224:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d 00000020:00000080:2.0:1788836425.077233:0:7628:0:(genops.c:885:class_export_put()) final put ffff9bd079858800/7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d 00000020:00000080:1.0:1788836425.077293:0:15891:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd079858800/7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d for lustre-OST0001 00000020:00000080:1.0:1788836425.077367:0:15891:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd07985e000 for lustre-OST0001 00010000:00010000:1.0:1788836425.425073:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836426.448565:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836427.090310:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538540672:0@lo:400:kworker.0 00000100:00100000:1.0:1788836427.090381:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538540800:0@lo:400:kworker.0 00000100:00100000:3.0:1788836427.090627:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836427.090710:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538540672 00000100:00100000:2.0:1788836427.090720:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538540672 00000100:00100000:3.0:1788836427.090722:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875730538541184:0@lo:400:kworker.0 00000100:00100000:3.0:1788836427.090764:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836427.090788:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788836427.090796:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07accaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8cc5c45-b703-4cf0-83fd-6722cde04691:3303:1875730538540544:0@lo:400:kworker.0 00000100:00100000:3.0:1788836427.090842:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836427.090868:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07accb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875730538541056:0@lo:400:kworker.0 00000100:00100000:3.0:1788836427.090892:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836427.090926:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538541184 00000100:00100000:3.0:1788836427.090933:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538541184 00000100:00100000:0.0:1788836427.091424:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875730538540928:0@lo:400:kworker.0 00000100:00100000:3.0:1788836427.091430:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538541056 00000100:00100000:3.0:1788836427.091435:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538541056 00000100:00100000:2.0:1788836427.091443:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788836427.091457:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538540672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836427.091466:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788836427.091475:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875730538541184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836427.091528:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836427.091551:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538540672:12345-0@lo:400:kworker.0 Request processed in 98us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836427.091552:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875730538541184:12345-0@lo:400:kworker.0 Request processed in 78us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836427.091575:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788836427.091583:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788836427.091607:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538540928 00000100:00100000:0.0:1788836427.091614:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538540928 00000100:00100000:3.0:1788836427.091619:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1788836427.091625:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836427.091627:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875730538541056:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788836427.091633:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836427.091651:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788836427.091664:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875730538540928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836427.091695:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875730538541056:12345-0@lo:400:kworker.0 Request processed in 66us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836427.091711:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836427.091714:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875730538540928:12345-0@lo:400:kworker.0 Request processed in 55us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836427.091992:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538540800 00000100:00100000:1.0:1788836427.091996:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538540800 00000100:00100000:1.0:1788836427.092032:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788836427.092039:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538540800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836427.092072:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538540800:12345-0@lo:400:kworker.0 Request processed in 35us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836427.092078:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788836427.092097:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538541312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788836427.092122:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836427.092153:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538540800:0@lo:400:kworker.0 00000100:00100000:1.0:1788836427.092191:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538541312 00000100:00100000:1.0:1788836427.092194:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538541312 00000100:00100000:1.0:1788836427.092219:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788836427.092226:0:14989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07accad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538541312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788836427.092249:0:14989:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788836427.092284:0:14989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07accad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538541312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836427.092290:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788836427.092318:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538541312:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788836427.092906:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788836427.092919:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788836427.092941:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07accb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875730538541056:0@lo:400:kworker.0 00000100:00100000:2.0:1788836427.092959:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875730538541184:0@lo:400:kworker.0 00000100:00100000:3.0:1788836427.092976:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538540544 00000100:00100000:3.0:1788836427.092985:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538540544 00000100:00100000:2.0:1788836427.092985:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538540672:0@lo:400:kworker.0 00000100:00100000:0.0:1788836427.093239:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788836427.093399:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875730538540928:0@lo:400:kworker.0 00000100:00100000:0.0:1788836427.093451:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788836427.093460:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079314050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:3303:x1875730538540544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836427.093515:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079314050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:3303:x1875730538540544:12345-0@lo:400:kworker.0 Request processed in 55us (2670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836427.093522:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788836427.093541:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07accaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8cc5c45-b703-4cf0-83fd-6722cde04691:3303:1875730538540544:0@lo:400:kworker.0 00010000:00010000:1.0:1788836427.473163:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836427.550454:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836427.550498:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836427.550536:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836427.550604:0:16533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518640128 00000100:00100000:0.0:1788836427.550614:0:16533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518640128 00000100:00100000:0.0:1788836427.550675:0:16533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518640000 00000100:00100000:0.0:1788836427.550678:0:16533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518640000 00000100:00100000:0.0:1788836427.550694:0:16533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518640256 00000100:00100000:0.0:1788836427.550697:0:16533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518640256 00000100:00100000:0.0:1788836427.550715:0:16533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:0.0:1788836427.550723:0:16533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:33da8487-9547-4be0-bbdf-a73d9371b5ba+12:2353:x1875730518640128:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836427.550738:0:16533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836427.550756:0:16533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd08217de00/0xcb5b7bc40b90a6fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab4f expref: 12 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836427.550774:0:16533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836427.550868:0:16533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:33da8487-9547-4be0-bbdf-a73d9371b5ba+11:2353:x1875730518640128:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 145us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836427.550876:0:16533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:0.0:1788836427.550893:0:16533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:0.0:1788836427.550899:0:16533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:33da8487-9547-4be0-bbdf-a73d9371b5ba+10:2353:x1875730518640000:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836427.550907:0:16533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836427.550916:0:16533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd047998800/0xcb5b7bc40b90a6f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab25 expref: 10 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836427.550943:0:16533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836427.550983:0:16533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:33da8487-9547-4be0-bbdf-a73d9371b5ba+9:2353:x1875730518640000:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 83us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836427.550990:0:16533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:0.0:1788836427.551003:0:16533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:0.0:1788836427.551009:0:16533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:33da8487-9547-4be0-bbdf-a73d9371b5ba+8:2353:x1875730518640256:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836427.551016:0:16533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836427.551026:0:16533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd040031600/0xcb5b7bc40b90a734 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab87 expref: 8 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836427.551034:0:16533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836427.551051:0:16533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:33da8487-9547-4be0-bbdf-a73d9371b5ba+7:2353:x1875730518640256:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 42us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836427.551057:0:16533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:3.0:1788836427.593216:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836427.593335:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518640512 00000100:00100000:2.0:1788836427.593384:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518640512 00000100:00100000:2.0:1788836427.593482:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:2.0:1788836427.593492:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03b72b3e-8a8e-455d-8604-5896fa644ca9+6:2352:x1875730518640512:12345-192.168.203.52@tcp:39:umount.0 00000020:00000080:2.0:1788836427.593546:0:14304:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a70a 00000020:00010000:2.0:1788836427.593554:0:14304:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9bcf479b4000: total 0 00000100:00080000:2.0:1788836427.593559:0:14304:0:(import.c:65:import_set_state_nolock()) ffff9bcf479b0800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788836427.593587:0:14304:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000020:00010000:1.0:1788836427.593618:0:14291:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9bcf479b4000: total 0 00010000:00010000:1.0:1788836427.593660:0:14291:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bcf479b4000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788836427.593689:0:14291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940b400) 00010000:00010000:1.0:1788836427.593692:0:14291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788836427.593699:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2c00/0xcb5b7bc40b90a7e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abb1 expref: 6 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836427.593723:0:14291:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bcf479b4000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788836427.593733:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836427.593735:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836427.593736:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836427.593787:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03b72b3e-8a8e-455d-8604-5896fa644ca9+3:2352:x1875730518640512:12345-192.168.203.52@tcp:39:umount.0 Request processed in 295us (586us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1788836427.593795:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00080000:0.0:1788836427.593916:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836427.600672:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788836427.600695:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a359180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538541440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836427.600762:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836427.600994:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538541440 00000100:00100000:3.0:1788836427.601002:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538541440 00000100:00100000:3.0:1788836427.601051:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788836427.601060:0:14989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07accb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538541440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788836427.601093:0:14989:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788836427.601146:0:14989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07accb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538541440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836427.601154:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788836427.601434:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a359180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538541440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836427.648895:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836427.649185:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518640768 00000100:00100000:3.0:1788836427.649196:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518640768 00000100:00100000:3.0:1788836427.649254:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 130 00000100:00100000:3.0:1788836427.649263:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079314c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33da8487-9547-4be0-bbdf-a73d9371b5ba+7:2352:x1875730518640768:12345-192.168.203.52@tcp:251:umount.0 00000020:00000080:3.0:1788836427.649312:0:14296:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a6af 00000020:00010000:3.0:1788836427.649320:0:14296:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9bcf46073000: total 0 00000100:00080000:3.0:1788836427.649324:0:14296:0:(import.c:65:import_set_state_nolock()) ffff9bcf46073800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788836427.649428:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079314c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33da8487-9547-4be0-bbdf-a73d9371b5ba+3:2352:x1875730518640768:12345-192.168.203.52@tcp:251:umount.0 Request processed in 166us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836427.649435:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 130 00000020:00010000:1.0:1788836427.649897:0:16002:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9bcf46073000: total 0 00010000:00010000:1.0:1788836427.649939:0:16002:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bcf46073000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788836427.649976:0:16002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd047998200/0xcb5b7bc40b90a6b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aabc expref: 2 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836427.649991:0:16002:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bcf46073000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788836427.650000:0:16002:0:(genops.c:885:class_export_put()) final put ffff9bcf46073000/33da8487-9547-4be0-bbdf-a73d9371b5ba 00010000:00010000:1.0:1788836427.650019:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836427.650022:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836427.650023:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788836427.650131:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bcf46073000/33da8487-9547-4be0-bbdf-a73d9371b5ba for MGS 00000020:00000080:3.0:1788836427.650169:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bcf46073800 for MGS 00010000:00010000:0.0:1788836428.496717:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788836429.261339:0:5851:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d 00000001:00080000:3.0:1788836429.261383:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:3.0:1788836429.261395:0:5851:0:(genops.c:885:class_export_put()) final put ffff9bcf46074800/7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d 00000001:00100000:3.0:1788836429.261427:0:5851:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 03b72b3e-8a8e-455d-8604-5896fa644ca9 00000001:00080000:3.0:1788836429.261434:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:3.0:1788836429.261437:0:5851:0:(genops.c:885:class_export_put()) final put ffff9bcf479b4000/03b72b3e-8a8e-455d-8604-5896fa644ca9 00000020:00000080:0.0:1788836429.261661:0:15891:0:(genops.c:844:class_export_destroy()) destroying export ffff9bcf46074800/7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d for lustre-MDT0000 00000020:00000080:1.0:1788836429.262105:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bcf479b4000/03b72b3e-8a8e-455d-8604-5896fa644ca9 for lustre-MDT0000 00000020:00000080:1.0:1788836429.262155:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd05274f800 for lustre-MDT0000 00000020:00000080:1.0:1788836429.262163:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bcf479b0800 for lustre-MDT0000 00010000:00010000:1.0:1788836429.520576:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788836429.720950:0:17444:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788836429.731486:0:17444:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788836429.731528:0:17444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd08217d400/0xcb5b7bc40b90a3de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a3e5 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.731557:0:17444:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd08217d400/0xcb5b7bc40b90a3de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90a3e5 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.731564:0:17444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd08217d400/0xcb5b7bc40b90a3de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b90a3e5 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.731572:0:17444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9bd08217d400/0xcb5b7bc40b90a3de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b90a3e5 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.731599:0:17444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788836429.731604:0:17444:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788836429.731622:0:17444:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788836429.731627:0:17444:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788836429.731632:0:17444:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788836429.731654:0:17444:0:(import.c:65:import_set_state_nolock()) ffff9bd04ebfb000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788836429.731685:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875730538541568:0@lo:39:umount.0 00000100:00100000:2.0:1788836429.731768:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836429.731849:0:16587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538541568 00000100:00100000:2.0:1788836429.731856:0:16587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538541568 00000100:00100000:2.0:1788836429.731894:0:16587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788836429.731904:0:16587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875730538541568:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788836429.731927:0:16587:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a40f 00000100:00080000:2.0:1788836429.731934:0:16587:0:(import.c:65:import_set_state_nolock()) ffff9bd048716000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788836429.731987:0:16587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3301:x1875730538541568:12345-0@lo:39:umount.0 Request processed in 83us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836429.731993:0:16587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000020:00000080:2.0:1788836429.732001:0:16587:0:(genops.c:885:class_export_put()) final put ffff9bd048717800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1788836429.732036:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd04ebfb000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:0.0:1788836429.732205:0:16002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836429.732212:0:16002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd08217d400/0xcb5b7bc40b90a3de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b90a3e5 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.732220:0:16002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217d400 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:0.0:1788836429.732223:0:16002:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd08217d400/0xcb5b7bc40b90a3de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b90a3e5 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.732241:0:16002:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd08217d400/0xcb5b7bc40b90a3de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb5b7bc40b90a3e5 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836429.732248:0:16002:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd08217d400/0xcb5b7bc40b90a3de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb5b7bc40b90a3e5 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836429.732253:0:16002:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788836429.732255:0:16002:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788836429.732257:0:16002:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788836429.732282:0:16002:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd08217d400/0xcb5b7bc40b90a3de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b90a3e5 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.732288:0:16002:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836429.732308:0:16002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd08217d400/0xcb5b7bc40b90a3de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b90a3e5 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.732314:0:16002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd08217d400/0xcb5b7bc40b90a3de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b90a3e5 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.732324:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836429.732325:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836429.732327:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836429.732337:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788836429.732365:0:15891:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd048717800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788836429.732406:0:15891:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd048716000 for lustre-MDT0000 00000100:00100000:0.0:1788836429.732420:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a359180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8cc5c45-b703-4cf0-83fd-6722cde04691:3302:1875730538541696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836429.732450:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836429.732491:0:16533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538541696 00000100:00100000:0.0:1788836429.732495:0:16533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538541696 00000100:00100000:0.0:1788836429.732549:0:16533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788836429.732555:0:16533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a35b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:3302:x1875730538541696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836429.732566:0:16533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836429.732579:0:16533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd07978b800/0xcb5b7bc40b90a3e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb5b7bc40b90a3de expref: 19 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.732590:0:16533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836429.732618:0:16533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a35b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e8cc5c45-b703-4cf0-83fd-6722cde04691+18:3302:x1875730538541696:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836429.732624:0:16533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788836429.732654:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a359180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8cc5c45-b703-4cf0-83fd-6722cde04691:3302:1875730538541696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788836429.732960:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875730538541568:0@lo:39:umount.0 00000100:00080000:2.0:1788836429.732983:0:17444:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788836429.732985:0:17444:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788836429.732989:0:17444:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788836429.734460:0:17444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047999000/0xcb5b7bc40b90a344 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a34b expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.734475:0:17444:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047999000/0xcb5b7bc40b90a344 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90a34b expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.734483:0:17444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047999000/0xcb5b7bc40b90a344 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b90a34b expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.734490:0:17444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9bd047999000/0xcb5b7bc40b90a344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b90a34b expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836429.734529:0:17444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836429.734647:0:14291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836429.734654:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd047999000/0xcb5b7bc40b90a344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b90a34b expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.734662:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047999000 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:0.0:1788836429.734666:0:14291:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd047999000/0xcb5b7bc40b90a344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b90a34b expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.734675:0:14291:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd047999000/0xcb5b7bc40b90a344 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb5b7bc40b90a34b expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836429.734682:0:14291:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd047999000/0xcb5b7bc40b90a344 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb5b7bc40b90a34b expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836429.734687:0:14291:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788836429.734690:0:14291:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788836429.734728:0:14291:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd047999000/0xcb5b7bc40b90a344 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b90a34b expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.734745:0:14291:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836429.734765:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd047999000/0xcb5b7bc40b90a344 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b90a34b expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.734783:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836429.734793:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836429.734795:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836429.734903:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a359180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8cc5c45-b703-4cf0-83fd-6722cde04691:3303:1875730538541824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836429.734955:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836429.735002:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538541824 00000100:00100000:0.0:1788836429.735009:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538541824 00000100:00100000:0.0:1788836429.735059:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788836429.735067:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a35b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8cc5c45-b703-4cf0-83fd-6722cde04691+18:3303:x1875730538541824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836429.735079:0:14288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836429.735092:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd042c0d200/0xcb5b7bc40b90a34b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb5b7bc40b90a344 expref: 18 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836429.735106:0:14288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836429.735138:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a35b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8cc5c45-b703-4cf0-83fd-6722cde04691+17:3303:x1875730538541824:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836429.735144:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788836429.735186:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a359180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8cc5c45-b703-4cf0-83fd-6722cde04691:3303:1875730538541824:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788836429.736862:0:17444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd047999000/0xcb5b7bc40b90a344 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b90a34b expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.739647:0:17444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd07978b000/0xcb5b7bc40b90a5dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a5e4 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.739664:0:17444:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd07978b000/0xcb5b7bc40b90a5dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90a5e4 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.739672:0:17444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd07978b000/0xcb5b7bc40b90a5dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b90a5e4 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.739679:0:17444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9bd07978b000/0xcb5b7bc40b90a5dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b90a5e4 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.739748:0:17444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836429.739756:0:17444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047999600/0xcb5b7bc40b90a75e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a765 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.739763:0:17444:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047999600/0xcb5b7bc40b90a75e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90a765 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.739877:0:17444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047999600/0xcb5b7bc40b90a75e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b90a765 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.739886:0:17444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9bd047999600/0xcb5b7bc40b90a75e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b90a765 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.739950:0:17444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788836429.739957:0:17444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047999c00/0xcb5b7bc40b90a336 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a33d expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.739964:0:17444:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047999c00/0xcb5b7bc40b90a336 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90a33d expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.739971:0:17444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047999c00/0xcb5b7bc40b90a336 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b90a33d expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836429.739977:0:17444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9bd047999c00/0xcb5b7bc40b90a336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b90a33d expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.744781:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788836429.744804:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd07978b000/0xcb5b7bc40b90a5dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b90a5e4 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.744815:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978b000 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:1.0:1788836429.744819:0:14292:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd07978b000/0xcb5b7bc40b90a5dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b90a5e4 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.744829:0:14292:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd07978b000/0xcb5b7bc40b90a5dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb5b7bc40b90a5e4 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836429.744836:0:14292:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd07978b000/0xcb5b7bc40b90a5dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb5b7bc40b90a5e4 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836429.744841:0:14292:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788836429.744853:0:14292:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788836429.744856:0:14292:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788836429.744892:0:14292:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd07978b000/0xcb5b7bc40b90a5dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b90a5e4 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.744899:0:14292:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788836429.744923:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd07978b000/0xcb5b7bc40b90a5dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b90a5e4 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.744930:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd07978b000/0xcb5b7bc40b90a5dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b90a5e4 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.744947:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788836429.744950:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd047999600/0xcb5b7bc40b90a75e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b90a765 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.744955:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047999600 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:1.0:1788836429.744958:0:14292:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd047999600/0xcb5b7bc40b90a75e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b90a765 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.744965:0:14292:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd047999600/0xcb5b7bc40b90a75e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb5b7bc40b90a765 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836429.744971:0:14292:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd047999600/0xcb5b7bc40b90a75e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb5b7bc40b90a765 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836429.744976:0:14292:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788836429.744978:0:14292:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788836429.744980:0:14292:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788836429.744992:0:14292:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd047999600/0xcb5b7bc40b90a75e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b90a765 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.745007:0:14292:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788836429.745014:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd047999600/0xcb5b7bc40b90a75e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b90a765 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.745020:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd047999600/0xcb5b7bc40b90a75e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b90a765 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.745030:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836429.745033:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd047999c00/0xcb5b7bc40b90a336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b90a33d expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.745038:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047999c00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:1.0:1788836429.745055:0:14292:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd047999c00/0xcb5b7bc40b90a336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b90a33d expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.745062:0:14292:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd047999c00/0xcb5b7bc40b90a336 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb5b7bc40b90a33d expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836429.745068:0:14292:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd047999c00/0xcb5b7bc40b90a336 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb5b7bc40b90a33d expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836429.745073:0:14292:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788836429.745075:0:14292:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:1.0:1788836429.745088:0:14292:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd047999c00/0xcb5b7bc40b90a336 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b90a33d expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.745093:0:14292:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788836429.745108:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd047999c00/0xcb5b7bc40b90a336 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b90a33d expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.745126:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836429.745128:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836429.745130:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836429.745148:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8cc5c45-b703-4cf0-83fd-6722cde04691:3304:1875730538541952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788836429.745214:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836429.745262:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788836429.745268:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07accaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8cc5c45-b703-4cf0-83fd-6722cde04691:3304:1875730538542080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788836429.745290:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836429.745319:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8cc5c45-b703-4cf0-83fd-6722cde04691:3302:1875730538542208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788836429.745340:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836429.745405:0:16533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538541952 00000100:00100000:1.0:1788836429.745412:0:16533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538541952 00000100:00100000:1.0:1788836429.745449:0:16533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538542080 00000100:00100000:1.0:1788836429.745452:0:16533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538542080 00000100:00100000:1.0:1788836429.745469:0:16533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538542208 00000100:00100000:1.0:1788836429.745472:0:16533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538542208 00000100:00100000:1.0:1788836429.745488:0:16533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788836429.745496:0:16533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07945d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:3304:x1875730538541952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788836429.745508:0:16533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836429.745519:0:16533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd047999800/0xcb5b7bc40b90a5e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb5b7bc40b90a5dd expref: 19 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.745533:0:16533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836429.746254:0:16533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07945d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e8cc5c45-b703-4cf0-83fd-6722cde04691+18:3304:x1875730538541952:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836429.746267:0:16533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788836429.746327:0:16533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788836429.746336:0:16533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e8cc5c45-b703-4cf0-83fd-6722cde04691+17:3304:x1875730538542080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788836429.746365:0:16533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836429.746378:0:16533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd047998600/0xcb5b7bc40b90a765 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb5b7bc40b90a75e expref: 17 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.746389:0:16533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836429.746418:0:16533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e8cc5c45-b703-4cf0-83fd-6722cde04691+16:3304:x1875730538542080:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836429.746424:0:16533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788836429.746437:0:16533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788836429.746443:0:16533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e8cc5c45-b703-4cf0-83fd-6722cde04691+15:3302:x1875730538542208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788836429.746450:0:16533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836429.746458:0:16533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd042c0c400/0xcb5b7bc40b90a33d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb5b7bc40b90a336 expref: 15 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836429.746469:0:16533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836429.746497:0:16533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e8cc5c45-b703-4cf0-83fd-6722cde04691+14:3302:x1875730538542208:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836429.746503:0:16533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788836429.747190:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8cc5c45-b703-4cf0-83fd-6722cde04691:3302:1875730538542208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788836429.747235:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07accaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8cc5c45-b703-4cf0-83fd-6722cde04691:3304:1875730538542080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788836429.747245:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8cc5c45-b703-4cf0-83fd-6722cde04691:3304:1875730538541952:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836429.756535:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836429.756628:0:17444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788836429.756640:0:17444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd047999c00/0xcb5b7bc40b90a336 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b90a33d expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836429.756660:0:17444:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:3.0:1788836429.756666:0:17444:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1788836429.756668:0:17444:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788836429.756767:0:17444:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788836429.756772:0:17444:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788836429.756777:0:17444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788836429.756782:0:17444:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788836429.756802:0:17444:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9bcf45117000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788836429.756809:0:17444:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9bd07985e800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788836429.756813:0:17444:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9bd07b2b4d28) has exports, disconnecting them 00000020:00080000:3.0:1788836429.756818:0:17444:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bcf45117000), last request at 1788836427 00000020:00000080:3.0:1788836429.756838:0:17444:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a5cf 00000100:00080000:3.0:1788836429.756852:0:17444:0:(import.c:65:import_set_state_nolock()) ffff9bcf45113800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788836429.756896:0:17444:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bcf45117000): rc 0 00000020:00000080:3.0:1788836429.756899:0:17444:0:(genops.c:885:class_export_put()) final put ffff9bcf45117000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788836429.756907:0:17444:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bd07985e800), last request at 1788836427 00000020:00000080:3.0:1788836429.756910:0:17444:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a494 00000100:00080000:3.0:1788836429.756915:0:17444:0:(import.c:65:import_set_state_nolock()) ffff9bd07985d800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788836429.756923:0:17444:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd07985e800): rc 0 00000020:00000080:3.0:1788836429.756925:0:17444:0:(genops.c:885:class_export_put()) final put ffff9bd07985e800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1788836429.756932:0:17444:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa7ccc1e23ae0 00000100:00080000:3.0:1788836429.756950:0:17444:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788836429.756954:0:17444:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1788836429.756963:0:17444:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788836429.757020:0:17444:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788836429.757054:0:17444:0:(import.c:65:import_set_state_nolock()) ffff9bd07a3ab800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788836429.757068:0:17444:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788836429.757070:0:17444:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 3 00000004:00080000:3.0:1788836429.757079:0:17444:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788836429.757146:0:17444:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788836429.757154:0:17444:0:(import.c:65:import_set_state_nolock()) ffff9bd078fef800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788836429.757180:0:17444:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9bd07b2b4d28) has no exports 00010000:00010000:3.0:1788836429.757216:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836429.757594:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538542336:0@lo:9:umount.0 00000100:00100000:2.0:1788836429.757656:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836429.757687:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538542464:0@lo:9:umount.0 00000100:00100000:2.0:1788836429.757708:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836429.757742:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538542336 00000100:00100000:2.0:1788836429.757749:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538542336 00000100:00100000:2.0:1788836429.757802:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538542464 00000100:00100000:2.0:1788836429.757805:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538542464 00000100:00100000:2.0:1788836429.757826:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788836429.757834:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875730538542336:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788836429.757855:0:14987:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a4b0 00000100:00080000:2.0:1788836429.757861:0:14987:0:(import.c:65:import_set_state_nolock()) ffff9bd04790c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788836429.757889:0:14987:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1788836429.758183:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3301:x1875730538542336:12345-0@lo:9:umount.0 Request processed in 348us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836429.758191:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788836429.758206:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788836429.758213:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875730538542464:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788836429.758224:0:14987:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a5eb 00000100:00080000:2.0:1788836429.758230:0:14987:0:(import.c:65:import_set_state_nolock()) ffff9bcf46077000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788836429.758244:0:14987:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:2.0:1788836429.758452:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3301:x1875730538542464:12345-0@lo:9:umount.0 Request processed in 239us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836429.758467:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788836429.758491:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788836429.758494:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788836429.758526:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd07a3ab800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788836429.758531:0:3301:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788836429.758532:0:3301:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788836429.758536:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538542336:0@lo:9:umount.0 00000100:00080000:2.0:1788836429.758546:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd078fef800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788836429.758555:0:3301:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788836429.758557:0:3301:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788836429.758559:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538542464:0@lo:9:umount.0 00010000:00010000:2.0:1788836429.758585:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788836429.760515:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bcf45117000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788836429.760596:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07985e800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788836429.760619:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bcf45113800 for lustre-MDT0000 00000020:00000080:0.0:1788836429.760635:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd07985d800 for lustre-MDT0000 00010000:00010000:0.0:1788836429.760662:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836429.766339:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788836429.774264:0:17444:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9bd07b2b4d28) has no exports 00000020:00000080:0.0:1788836429.874886:0:17444:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a391 00000020:00000080:0.0:1788836429.876013:0:17444:0:(genops.c:885:class_export_put()) final put ffff9bd042e76800/lustre-QMT0000_UUID 00000020:01000000:0.0:1788836429.876036:0:17444:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788836429.876123:0:17444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788836429.876133:0:17444:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788836429.876150:0:17444:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9bd07bbd0000) has no exports 00000020:00000080:2.0:1788836429.876238:0:15891:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd042e76800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788836429.876455:0:17444:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a38a 00000020:00000080:1.0:1788836429.876461:0:17444:0:(genops.c:885:class_export_put()) final put ffff9bd042e72800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788836429.876503:0:15891:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd042e72800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788836429.876522:0:17444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788836429.876529:0:17444:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788836429.876532:0:17444:0:(genops.c:885:class_export_put()) final put ffff9bd0586fa000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788836429.876534:0:17444:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd0586fa000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788836429.876544:0:17444:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1788836429.876641:0:17444:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd045d9cd20 - data ffff9bd05fc65bd0/ffff9bcf47869000 00000020:01000000:1.0:1788836429.876781:0:17444:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd079d9dd80 - data ffff9bd051b25288/ffff9bd0444e4c00 00000001:00000004:1.0:1788836429.897040:0:17444:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:3.0:1788836429.983069:0:17444:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788836429.983078:0:17444:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1788836429.983100:0:17444:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788836429.983102:0:17444:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788836429.983636:0:14325:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788836429.983645:0:14325:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1788836429.983655:0:14325:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1788836429.985067:0:17444:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788836429.985072:0:17444:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 4 00000004:00080000:3.0:1788836429.985132:0:17444:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788836429.985142:0:17444:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788836429.985461:0:14327:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788836429.985465:0:14327:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:0.0:1788836429.985472:0:14327:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1788836430.061276:0:17444:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a359 00000020:00000080:3.0:1788836430.061289:0:17444:0:(genops.c:885:class_export_put()) final put ffff9bd07a3ae000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788836430.061383:0:15891:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07a3ae000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788836430.063089:0:17444:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a36e 00000020:00000080:0.0:1788836430.063101:0:17444:0:(genops.c:885:class_export_put()) final put ffff9bd07a3ab000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788836430.063157:0:17444:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788836430.063163:0:17444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788836430.063172:0:17444:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788836430.063176:0:17444:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9bd07b2b0000) has no exports 00000004:01000000:0.0:1788836430.063376:0:17444:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788836430.063385:0:17444:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a3bb 00000020:00000080:0.0:1788836430.063390:0:17444:0:(genops.c:885:class_export_put()) final put ffff9bd07b267000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788836430.063536:0:15891:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07a3ab000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788836430.063646:0:17444:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788836430.063651:0:17444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788836430.063656:0:17444:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788836430.063659:0:17444:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9bd07d37cd28) has no exports 00000020:00000080:0.0:1788836430.063664:0:17444:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a3b4 00000020:00000080:0.0:1788836430.063668:0:17444:0:(genops.c:885:class_export_put()) final put ffff9bd078fea000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788836430.063776:0:15891:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07b267000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788836430.063792:0:15891:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd078fea000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788836430.064514:0:17444:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788836430.064519:0:17444:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788836430.064523:0:17444:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 5 00000004:00080000:0.0:1788836430.064538:0:17444:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788836430.064612:0:17444:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788836430.064680:0:15891:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd078fef800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788836430.064697:0:17444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836430.064704:0:17444:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788836430.064707:0:17444:0:(genops.c:885:class_export_put()) final put ffff9bd078fab000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788836430.064711:0:17444:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd078fab000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788836430.064716:0:17444:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788836430.064797:0:17444:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a3a6 00000020:00000080:0.0:1788836430.064802:0:17444:0:(genops.c:885:class_export_put()) final put ffff9bd078fa8800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788836430.064816:0:17444:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788836430.064821:0:17444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788836430.064824:0:17444:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788836430.064827:0:17444:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9bd07bbd19b8) has no exports 00000020:00000080:0.0:1788836430.064831:0:17444:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a39f 00000020:00000080:0.0:1788836430.064835:0:17444:0:(genops.c:885:class_export_put()) final put ffff9bd07a3ac800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788836430.064988:0:15891:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd078fa8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788836430.064995:0:15891:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07a3ac800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788836430.066140:0:17444:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788836430.066146:0:17444:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788836430.066150:0:17444:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1788836430.066156:0:17444:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788836430.066159:0:17444:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788836430.066205:0:17444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836430.066214:0:17444:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788836430.066243:0:17444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836430.066247:0:17444:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788836430.066251:0:17444:0:(genops.c:885:class_export_put()) final put ffff9bd0612ea000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788836430.066255:0:17444:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd0612ea000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788836430.066262:0:17444:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788836430.066641:0:15891:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd07a3ab800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788836430.066649:0:15891:0:(genops.c:885:class_export_put()) final put ffff9bd078fad000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788836430.066652:0:15891:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd078fad000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788836430.066656:0:15891:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788836430.066832:0:17444:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a375 00000020:00000080:0.0:1788836430.066839:0:17444:0:(genops.c:885:class_export_put()) final put ffff9bd07a3af000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788836430.066858:0:17444:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788836430.066862:0:17444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788836430.066877:0:17444:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788836430.066880:0:17444:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9bd07bbd4d28) has no exports 00000020:00000080:0.0:1788836430.066911:0:17444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836430.066915:0:17444:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788836430.066920:0:17444:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a37c 00000020:00000080:0.0:1788836430.066924:0:17444:0:(genops.c:885:class_export_put()) final put ffff9bd07a3a9000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788836430.066932:0:17444:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bcf45ede000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788836430.066935:0:17444:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bcf45ede000 3 00000020:01000004:0.0:1788836430.066938:0:17444:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bcf45ede000 from lustre-MDT0000 00000020:00000080:0.0:1788836430.066954:0:17444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836430.066957:0:17444:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788836430.066960:0:17444:0:(genops.c:885:class_export_put()) final put ffff9bd07a3a8000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788836430.066962:0:17444:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07a3a8000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788836430.066969:0:17444:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788836430.066994:0:17444:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788836430.066998:0:17444:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788836430.067001:0:17444:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788836430.067003:0:17444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788836430.067006:0:17444:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788836430.067013:0:17444:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9bd07ae75800 e8cc5c45-b703-4cf0-83fd-6722cde04691 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788836430.067018:0:17444:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9bd07b2b3370) has exports, disconnecting them 00000020:00080000:0.0:1788836430.067022:0:17444:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9bd07ae75800), last request at 1788836350 00000020:00000080:0.0:1788836430.067037:0:17444:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a321 00000020:00010000:0.0:1788836430.067041:0:17444:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9bd07ae75800: total 2 00000100:00080000:0.0:1788836430.067045:0:17444:0:(import.c:65:import_set_state_nolock()) ffff9bd07ae70000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788836430.067063:0:17444:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd07ae75800): rc 0 00000020:00080000:0.0:1788836430.067068:0:17444:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9bd07b2b3370) has no exports 00000020:00000080:1.0:1788836430.067333:0:15891:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07a3af000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788836430.067338:0:15891:0:(genops.c:885:class_export_put()) final put ffff9bd07a3ae800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788836430.067357:0:15891:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07a3ae800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788836430.067363:0:15891:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788836430.067461:0:15891:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07a3a9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1788836430.068590:0:14298:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9bd0517bb400:14298] 2 exiting: rc = 0 00000100:00100000:3.0:1788836430.068842:0:14296:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9bd05a547a00:14296] 0 exiting: rc = 1 00000020:00010000:2.0:1788836430.069296:0:14292:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9bd07ae75800: total 0 00010000:00010000:2.0:1788836430.069302:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836430.069364:0:14292:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bd07ae75800, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1788836430.069398:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd08217cc00/0xcb5b7bc40b90a590 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb5b7bc40b90a589 expref: 9 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836430.069416:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd042c0c200/0xcb5b7bc40b90a5ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb5b7bc40b90a5b3 expref: 8 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836430.069427:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd07978aa00/0xcb5b7bc40b90a32f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb5b7bc40b90a328 expref: 7 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836430.069438:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd040030e00/0xcb5b7bc40b90a749 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb5b7bc40b90a742 expref: 6 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836430.069447:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd042c0c800/0xcb5b7bc40b90a47f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb5b7bc40b90a478 expref: 5 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836430.069474:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd047998400/0xcb5b7bc40b90a757 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb5b7bc40b90a750 expref: 4 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836430.069487:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd08217c800/0xcb5b7bc40b90a447 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb5b7bc40b90a440 expref: 3 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836430.069497:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd047998c00/0xcb5b7bc40b90a455 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb5b7bc40b90a44e expref: 2 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836430.069505:0:14292:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bd07ae75800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1788836430.069519:0:14292:0:(genops.c:885:class_export_put()) final put ffff9bd07ae75800/e8cc5c45-b703-4cf0-83fd-6722cde04691 00010000:00010000:2.0:1788836430.069528:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836430.069530:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836430.069532:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836430.069726:0:14297:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9bcf44af7a00:14297] 1 exiting: rc = 0 00000020:00000080:1.0:1788836430.070111:0:15891:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07ae75800/e8cc5c45-b703-4cf0-83fd-6722cde04691 for MGS 00000020:00000080:1.0:1788836430.070158:0:15891:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd07ae70000 for MGS 00000100:00100000:1.0:1788836430.070293:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070302:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070307:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070312:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070318:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070324:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070330:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070335:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070357:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070365:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070372:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070378:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070383:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070389:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070394:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070399:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070404:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070410:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070415:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070420:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070425:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070430:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070434:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070439:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070444:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070449:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070453:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070460:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070470:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070476:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070482:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070487:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070492:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070497:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070513:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070519:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070525:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070532:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070830:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070843:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070850:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070856:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070863:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070869:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070876:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070884:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070962:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070972:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070980:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070987:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.070994:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.071001:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.071008:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.071015:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.071022:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.071033:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.071044:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.071053:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.071058:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.071063:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.071069:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.071075:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.071079:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.071085:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1788836430.071689:0:17444:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788836430.071692:0:17444:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1788836430.072723:0:17444:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd045d9cc00 - data ffff9bd0661e6360/ffff9bcf4786b800 00000020:01000000:1.0:1788836430.072862:0:17444:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd050a3aa80 - data ffff9bd06633baf8/ffff9bd043cf9000 00000020:00000080:1.0:1788836430.073471:0:17444:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a305 00000020:00000080:1.0:1788836430.073486:0:17444:0:(genops.c:885:class_export_put()) final put ffff9bd07ae71800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788836430.073507:0:17444:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bcf45ede000 from MGS, refs=2 00000020:01000004:1.0:1788836430.073511:0:17444:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bcf45ede000 2 00000020:01000004:1.0:1788836430.073514:0:17444:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bcf45ede000 from MGS 00000020:00000080:1.0:1788836430.073532:0:17444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788836430.073538:0:17444:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788836430.073630:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07ae71800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788836430.073658:0:17444:0:(genops.c:885:class_export_put()) final put ffff9bd07ae72000/MGS 00000020:00000080:1.0:1788836430.073660:0:17444:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07ae72000/MGS for MGS 00000020:01000000:1.0:1788836430.073666:0:17444:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788836430.073715:0:17444:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788836430.073719:0:17444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788836430.073725:0:17444:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788836430.073731:0:17444:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9bd04ebf8800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788836430.073737:0:17444:0:(genops.c:1553:class_disconnect_exports()) OBD device 10 (ffff9bd07bbd3370) has exports, disconnecting them 00000020:00080000:1.0:1788836430.073742:0:17444:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9bd04ebf8800), last request at 1788836351 00000020:00000080:1.0:1788836430.073746:0:17444:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a3f3 00000020:00080000:1.0:1788836430.073755:0:17444:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd04ebf8800): rc 0 00000020:00000080:1.0:1788836430.073759:0:17444:0:(genops.c:885:class_export_put()) final put ffff9bd04ebf8800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788836430.073866:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd04ebf8800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788836430.076405:0:17444:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788836430.076415:0:17444:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788836430.076419:0:17444:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788836430.076436:0:17444:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788836430.078501:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd04ebfb000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788836430.079361:0:17444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836430.079373:0:17444:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788836430.079378:0:17444:0:(genops.c:885:class_export_put()) final put ffff9bd04ebfc000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788836430.079382:0:17444:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd04ebfc000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788836430.079389:0:17444:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788836430.079444:0:17444:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bcf45ede000 1 00000020:00000080:0.0:1788836430.079449:0:17444:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a2f7 00000020:00000080:0.0:1788836430.079455:0:17444:0:(genops.c:885:class_export_put()) final put ffff9bd07ae77000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788836430.079468:0:17444:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788836430.079472:0:17444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788836430.079475:0:17444:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788836430.079479:0:17444:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9bd07b233370) has no exports 00000020:00000080:3.0:1788836430.079576:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07ae77000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788836430.096863:0:17444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836430.096957:0:17444:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788836430.096964:0:17444:0:(genops.c:885:class_export_put()) final put ffff9bcf45ede800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788836430.096969:0:17444:0:(genops.c:844:class_export_destroy()) destroying export ffff9bcf45ede800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788836430.096980:0:17444:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788836430.097250:0:17444:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bcf45ed9800 00000020:01000000:0.0:1788836430.097269:0:17444:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788836430.097272:0:17444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788836430.097277:0:17444:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788836430.097280:0:17444:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9bd07b230000) has no exports 00000100:00100000:0.0:1788836430.097362:0:14305:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9bd0437b0800:14305] 2 exiting: rc = 0 00000100:00100000:2.0:1788836430.097974:0:14304:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9bd0437b0a00:14304] 1 exiting: rc = 0 00000100:00100000:2.0:1788836430.098036:0:16587:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9bcf46038800:16587] 3 exiting: rc = 0 00000100:00100000:0.0:1788836430.100690:0:14303:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9bd079770a00:14303] 0 exiting: rc = 1 00000100:00100000:0.0:1788836430.100806:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.100815:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.100823:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.100828:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.100834:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.100841:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.100847:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.100864:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.100869:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.100874:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.100879:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.100883:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.100888:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.100900:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.100906:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.100911:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.100916:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.100922:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.100928:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.100933:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.100938:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.100943:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.100949:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.100957:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.100962:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.100967:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.100973:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.100980:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.100986:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.100992:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.100997:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101002:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101007:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101012:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101026:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101033:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101045:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101050:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101055:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101060:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101064:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101071:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101081:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101086:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101094:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101099:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101104:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101109:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101113:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101118:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101127:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101134:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101139:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101144:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101154:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101161:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101166:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101174:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101179:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101183:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101197:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101202:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101207:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.101212:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104293:0:14307:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9bd047817800:14307] 1 exiting: rc = 0 00000100:00100000:1.0:1788836430.104510:0:14306:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9bd047817a00:14306] 0 exiting: rc = 1 00000100:00100000:0.0:1788836430.104715:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104722:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104728:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104733:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104738:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104742:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104747:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104752:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104756:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104761:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104765:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104770:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104792:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104797:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104802:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104806:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104811:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104815:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104820:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104825:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104830:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104834:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104839:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104843:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104848:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104852:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104857:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104861:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104865:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104870:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104874:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104878:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104882:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104887:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104900:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104906:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104912:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104917:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104922:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104927:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104932:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104937:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104941:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104946:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104951:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104955:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104961:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104972:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104977:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104982:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104987:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104992:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.104996:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.105001:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.105005:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.105010:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.105014:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.105019:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.105024:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.105029:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.105033:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.105038:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.105043:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.105048:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.105736:0:14309:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9bd07a821800:14309] 1 exiting: rc = 0 00000100:00100000:2.0:1788836430.105832:0:14308:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9bd07a821000:14308] 0 exiting: rc = 1 00000100:00100000:0.0:1788836430.105989:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.105996:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106002:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106007:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106013:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106024:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106031:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106037:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106043:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106055:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106062:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106068:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106073:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106079:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106084:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106089:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106095:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106100:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106111:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106116:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106122:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106138:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106144:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106149:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106155:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106160:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106165:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106171:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106176:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106182:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106249:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106256:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106261:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106278:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106284:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106290:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106295:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106301:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106307:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106312:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106318:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106323:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106330:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106334:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106360:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106379:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106388:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106393:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106399:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106404:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106410:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106415:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106420:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106430:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106436:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106445:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106451:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106457:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106470:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106476:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106481:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106486:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106491:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836430.106497:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836430.120771:0:14310:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9bd043d25c00:14310] 0 exiting: rc = 1 00000100:00100000:2.0:1788836430.120851:0:14311:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9bd043d25800:14311] 1 exiting: rc = 0 00000100:00100000:3.0:1788836430.120922:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.120934:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.120940:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.120945:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.120950:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.120955:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.120960:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.120965:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.120977:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.120984:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.120989:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.120995:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121005:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121010:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121018:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121023:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121027:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121033:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121038:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121043:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121048:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121053:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121058:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121063:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121068:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121086:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121094:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121099:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121104:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121108:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121113:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121117:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121122:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121127:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121132:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121137:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121142:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121150:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121155:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121160:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121164:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121169:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121173:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121178:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121182:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121264:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121269:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121274:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121279:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121283:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121288:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121292:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121299:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121303:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121308:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121312:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121316:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121320:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121325:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121329:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121339:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121413:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121418:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.121424:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.121976:0:14313:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9bd043d24000:14313] 1 exiting: rc = 0 00000100:00100000:1.0:1788836430.122110:0:14312:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9bd043d25600:14312] 0 exiting: rc = 1 00000100:00100000:2.0:1788836430.122477:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122484:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122489:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122494:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122498:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122503:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122507:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122512:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122518:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122522:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122527:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122538:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122622:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122626:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122631:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122635:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122640:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122645:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122650:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122654:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122659:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122663:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122668:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122673:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122677:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122681:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122685:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122689:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122694:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122697:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122701:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122705:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122709:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122713:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122717:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122722:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122726:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122731:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122738:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122743:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122747:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122752:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122756:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122760:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122764:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122769:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122778:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122792:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122797:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122802:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122806:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122810:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122815:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122820:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122824:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122828:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122833:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122837:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122841:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122845:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122849:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122853:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122857:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.122862:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.123236:0:14315:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9bd0496ca000:14315] 1 exiting: rc = 0 00000100:00100000:0.0:1788836430.123549:0:14314:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9bd049897000:14314] 0 exiting: rc = 1 00000100:00100000:2.0:1788836430.123609:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123616:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123621:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123626:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123632:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123637:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123643:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123647:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123652:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123657:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123661:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123665:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123668:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123671:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123675:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123678:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123681:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123691:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123694:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123698:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123701:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123705:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123708:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123711:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123714:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123717:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123720:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123723:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123726:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123728:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123731:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123734:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123737:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123740:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123743:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123746:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123749:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123752:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123755:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123758:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123761:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123763:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123766:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123769:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123772:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123774:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123777:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123779:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123793:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123799:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123804:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123809:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123819:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123824:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123829:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123834:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123840:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123844:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123850:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123854:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123859:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123863:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123868:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.123872:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836430.124559:0:14317:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9bd079803400:14317] 1 exiting: rc = 0 00000100:00100000:0.0:1788836430.124752:0:14316:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9bd079802200:14316] 0 exiting: rc = 1 00000100:00100000:1.0:1788836430.125090:0:14318:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9bd0504cf800:14318] 2 exiting: rc = 0 00000100:00100000:2.0:1788836430.125286:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.125295:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.125300:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.125306:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.125312:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.125318:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.125324:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.125330:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.125335:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.125982:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.125995:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126002:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126007:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126035:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126041:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126047:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126052:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126058:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126064:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126069:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126075:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126080:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126084:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126099:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126104:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126108:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126112:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126117:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126121:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126126:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126131:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126135:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126139:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126144:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126149:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126154:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126158:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126174:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126179:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126195:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126202:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126208:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126214:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126220:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126225:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126232:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126238:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126244:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126251:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126257:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126263:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126269:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126276:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126287:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126293:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126298:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126303:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126309:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126321:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126326:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126331:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126469:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126476:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836430.126482:0:17444:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788836430.131327:0:17444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788836430.131400:0:17444:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788836430.131408:0:17444:0:(genops.c:885:class_export_put()) final put ffff9bd077a68800/MDS_uuid 00000020:00000080:2.0:1788836430.131412:0:17444:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd077a68800/MDS_uuid for MDS 00000020:01000000:2.0:1788836430.131418:0:17444:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788836430.131546:0:17444:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000001:00100000:2.0:1788836430.212271:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788836430.212282:0:7628:0:(genops.c:885:class_export_put()) final put ffff9bcf46075000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788836430.212607:0:15891:0:(genops.c:844:class_export_destroy()) destroying export ffff9bcf46075000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788836430.215568:0:15891:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bcf46077000 for lustre-OST0001 00010000:00010000:0.0:1788836430.546098:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836431.568865:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836432.210434:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788836432.210454:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8cc5c45-b703-4cf0-83fd-6722cde04691:3302:1875730538542592:0@lo:400:kworker.0 00000400:00000100:0.0:1788836432.210503:0:3302:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875730538542592 offset 0 length 224: 4 00000100:00100000:0.0:1788836432.210561:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875730538542848:0@lo:400:kworker.0 00000400:00000100:0.0:1788836432.210582:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730538542848 offset 0 length 224: 4 00000100:00100000:0.0:1788836432.210596:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788836432.210602:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a35a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875730538542720:0@lo:400:kworker.0 00000400:00000100:0.0:1788836432.210618:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730538542720 offset 0 length 224: 4 00000001:00100000:3.0:1788836432.255694:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788836432.255702:0:6708:0:(genops.c:885:class_export_put()) final put ffff9bd04790c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788836432.255984:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd04790c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788836432.256032:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd04790c800 for lustre-OST0000 00010000:00010000:0.0:1788836432.595828:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788836433.384852:0:17596:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788836433.397596:0:17596:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788836433.397645:0:17596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd07978b200/0xcb5b7bc40b90a478 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a47f expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836433.397660:0:17596:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd07978b200/0xcb5b7bc40b90a478 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90a47f expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836433.397667:0:17596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd07978b200/0xcb5b7bc40b90a478 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b90a47f expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836433.397674:0:17596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9bd07978b200/0xcb5b7bc40b90a478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b90a47f expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836433.397699:0:17596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788836433.397704:0:17596:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788836433.397727:0:17596:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788836433.397738:0:17596:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd07a35a300 x1875730538542720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836448 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836433.397753:0:17596:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788836433.397758:0:17596:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788836433.397789:0:17596:0:(import.c:65:import_set_state_nolock()) ffff9bd043066000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788836433.397851:0:16002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836433.397859:0:16002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd07978b200/0xcb5b7bc40b90a478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b90a47f expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836433.397866:0:16002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978b200 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:0.0:1788836433.397870:0:16002:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd07978b200/0xcb5b7bc40b90a478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b90a47f expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836433.397892:0:16002:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd07978b200/0xcb5b7bc40b90a478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb5b7bc40b90a47f expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836433.397899:0:16002:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd07978b200/0xcb5b7bc40b90a478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb5b7bc40b90a47f expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836433.397904:0:16002:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788836433.397906:0:16002:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788836433.397908:0:16002:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788836433.397931:0:16002:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd07978b200/0xcb5b7bc40b90a478 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b90a47f expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836433.397938:0:16002:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836433.397968:0:16002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd07978b200/0xcb5b7bc40b90a478 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b90a47f expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836433.397975:0:16002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd07978b200/0xcb5b7bc40b90a478 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b90a47f expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836433.397986:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836433.397988:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836433.397990:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836433.398007:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788836433.398022:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a35ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8cc5c45-b703-4cf0-83fd-6722cde04691:3303:1875730538543104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788836433.398221:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a35a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875730538542720:0@lo:400:kworker.0 00000100:00100000:0.0:1788836433.398304:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836433.398386:0:16533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538543104 00000100:00100000:1.0:1788836433.398392:0:16533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538543104 00000100:00100000:2.0:1788836433.398425:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1875730538542976:0@lo:39:umount.0 00000100:00100000:1.0:1788836433.398432:0:16533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000400:00000100:2.0:1788836433.398451:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730538542976 offset 0 length 224: 4 00000100:00100000:1.0:1788836433.398454:0:16533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a35a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3303:x1875730538543104:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788836433.398460:0:16533:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788836433 with bad export cookie 14653441894517875489 00000100:00100000:0.0:1788836433.414506:0:16533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a35a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3303:x1875730538543104:12345-0@lo:103:ldlm_bl.0 Request processed in 16051us (16193us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788836433.414520:0:16533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788836433.414536:0:3303:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.152@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788836433.414542:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bd07ae76800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788836433.414545:0:3303:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788836433.425671:0:3303:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.152@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788836433.425677:0:3303:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788836433.425685:0:3303:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd07a359500 x1875730538542592/t0(0) o400->MGC192.168.203.152@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788836448 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836433.425796:0:3303:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd07a35ad80 x1875730538543104/t0(0) o103->MGC192.168.203.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788836449 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788836433.425806:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788836433.425809:0:3303:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788836433.425810:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788836433.425829:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bd07ae76800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788836433.425833:0:3303:0:(import.c:510:import_select_connection()) MGC192.168.203.152@tcp: connect to NID 0@lo last attempt 403 00000100:00080000:2.0:1788836433.425841:0:3303:0:(import.c:624:import_select_connection()) MGC192.168.203.152@tcp: import ffff9bd07ae76800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788836433.425868:0:3303:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd07a3ded80 x1875730538543232/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788836433.425905:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a35ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8cc5c45-b703-4cf0-83fd-6722cde04691:3303:1875730538543104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836433.426076:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e8cc5c45-b703-4cf0-83fd-6722cde04691:3301:1875730538543232:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:0.0:1788836433.426132:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875730538543232 offset 0 length 520: 4 00000100:00100000:3.0:1788836433.426337:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8cc5c45-b703-4cf0-83fd-6722cde04691:3302:1875730538542592:0@lo:400:kworker.0 00010000:00010000:0.0:1788836433.617282:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836434.640775:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836435.665899:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836436.690383:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788836437.329213:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) e8cc5c45-b703-4cf0-83fd-6722cde04691->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788836437.329236:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) e8cc5c45-b703-4cf0-83fd-6722cde04691->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788836437.329502:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875730538543360:0@lo:400:kworker.0 00000400:00000100:3.0:1788836437.329711:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730538543360 offset 0 length 224: 4 00010000:00010000:0.0:1788836437.713660:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788836438.357987:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) e8cc5c45-b703-4cf0-83fd-6722cde04691->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788836438.357997:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) e8cc5c45-b703-4cf0-83fd-6722cde04691->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788836438.358145:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a35b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875730538543488:0@lo:400:kworker.0 00000400:00000100:1.0:1788836438.358208:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730538543488 offset 0 length 224: 4 00010000:00010000:0.0:1788836438.736755:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836439.766575:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836440.785111:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836441.809157:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836442.833318:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788836443.472501:0:15891:0:(pinger.c:229:ptlrpc_pinger_process_import()) e8cc5c45-b703-4cf0-83fd-6722cde04691->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788836443.472511:0:15891:0:(pinger.c:247:ptlrpc_pinger_process_import()) e8cc5c45-b703-4cf0-83fd-6722cde04691->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788836443.472644:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788836443.472664:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875730538543616:0@lo:400:kworker.0 00000400:00000100:3.0:1788836443.472740:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730538543616 offset 0 length 224: 4 00010000:00010000:0.0:1788836443.859415:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836443.984479:0:3301:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836433/real 1788836433] req@ffff9bd07a3ded80 x1875730538543232/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788836443 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836443.984513:0:3301:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd07a3ded80 x1875730538543232/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788836443 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836443.984526:0:3301:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836433/real 1788836433] req@ffff9bd07ad01180 x1875730538542976/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788836443 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836443.984539:0:3301:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd07ad01180 x1875730538542976/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788836443 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788836443.984560:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd07ae76800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788836443.984589:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788836443.984594:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e8cc5c45-b703-4cf0-83fd-6722cde04691:3301:1875730538543232:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:2.0:1788836443.984600:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd043066000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788836443.984618:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1875730538542976:0@lo:39:umount.0 00000100:00080000:3.0:1788836443.984721:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) e8cc5c45-b703-4cf0-83fd-6722cde04691->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788836443.984727:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788836443.984730:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd07ae76800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788836443.984734:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.152@tcp: connect to NID 0@lo last attempt 486 00000100:00080000:3.0:1788836443.984739:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.152@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788836443.984745:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.152@tcp: import ffff9bd07ae76800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788836443.984777:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd07ad01180 x1875730538543744/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788836443.984848:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788836443.984860:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875730538543872:0@lo:400:kworker.0 00000400:00000100:3.0:1788836443.984908:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730538543872 offset 0 length 224: 4 00000100:00080000:0.0:1788836443.985129:0:17596:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788836443.985134:0:17596:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788836443.985140:0:17596:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788836443.986019:0:17596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b90a44e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a455 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836443.986033:0:17596:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b90a44e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90a455 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836443.986039:0:17596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b90a44e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b90a455 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836443.986061:0:17596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b90a44e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b90a455 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836443.986088:0:17596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836443.986096:0:17596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047999200/0xcb5b7bc40b90a750 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a757 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836443.986103:0:17596:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047999200/0xcb5b7bc40b90a750 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90a757 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836443.986110:0:17596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047999200/0xcb5b7bc40b90a750 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b90a757 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836443.986116:0:17596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9bd047999200/0xcb5b7bc40b90a750 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b90a757 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836443.986134:0:17596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788836443.986138:0:17596:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788836443.986158:0:17596:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788836443.986163:0:17596:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788836443.986167:0:17596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788836443.986173:0:17596:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788836443.986177:0:17596:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9bd07b234d28) has no exports 00000020:00080000:0.0:1788836443.986201:0:17596:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9bd07b234d28) has no exports 00000020:01000000:0.0:1788836443.987858:0:17596:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd0430f0120 - data ffff9bd05fc6c360/ffff9bcf46679800 00000020:01000000:0.0:1788836443.987979:0:17596:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd0454b0d80 - data ffff9bd051974360/ffff9bcf45ef2c00 00010000:00010000:1.0:1788836443.988494:0:16002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788836443.988503:0:16002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b90a44e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b90a455 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836443.988514:0:16002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0ca00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:1.0:1788836443.988518:0:16002:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b90a44e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b90a455 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836443.988528:0:16002:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b90a44e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb5b7bc40b90a455 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836443.988535:0:16002:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b90a44e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb5b7bc40b90a455 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836443.988540:0:16002:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788836443.988543:0:16002:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788836443.988546:0:16002:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788836443.988561:0:16002:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd07ae76800 00010000:00010000:1.0:1788836443.988564:0:16002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b90a44e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb5b7bc40b90a455 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836443.988570:0:16002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b90a44e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb5b7bc40b90a455 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836443.988581:0:16002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836443.988599:0:16002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd047999200/0xcb5b7bc40b90a750 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b90a757 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836443.988605:0:16002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047999200 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:1.0:1788836443.988608:0:16002:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd047999200/0xcb5b7bc40b90a750 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b90a757 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836443.988615:0:16002:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd047999200/0xcb5b7bc40b90a750 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb5b7bc40b90a757 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836443.988621:0:16002:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd047999200/0xcb5b7bc40b90a750 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb5b7bc40b90a757 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836443.988626:0:16002:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788836443.988628:0:16002:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788836443.988630:0:16002:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788836443.988636:0:16002:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd07ae76800 00010000:00010000:1.0:1788836443.988639:0:16002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd047999200/0xcb5b7bc40b90a750 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb5b7bc40b90a757 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836443.988645:0:16002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd047999200/0xcb5b7bc40b90a750 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb5b7bc40b90a757 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836443.988653:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836443.988655:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836443.988657:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836443.988719:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836443.988905:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e8cc5c45-b703-4cf0-83fd-6722cde04691:3301:1875730538543744:0@lo:250:kworker.0 00000400:00000100:2.0:1788836443.988965:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875730538543744 offset 0 length 520: 4 00100000:10000000:0.0:1788836444.001109:0:17596:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788836444.029588:0:17596:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a463 00000020:00000080:2.0:1788836444.029598:0:17596:0:(genops.c:885:class_export_put()) final put ffff9bd047f4b800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788836444.029612:0:17596:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd04ea62000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788836444.029615:0:17596:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd04ea62000 2 00000020:01000004:2.0:1788836444.029618:0:17596:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bd04ea62000 from lustre-OST0000 00000020:00000080:2.0:1788836444.029644:0:17596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788836444.029655:0:17596:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788836444.029658:0:17596:0:(genops.c:885:class_export_put()) final put ffff9bd047f49800/lustre-OST0000_UUID 00000020:00000080:2.0:1788836444.029660:0:17596:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd047f49800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788836444.029666:0:17596:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788836444.029712:0:17596:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788836444.029716:0:17596:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788836444.029720:0:17596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788836444.029725:0:17596:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788836444.029732:0:17596:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9bd047f48800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788836444.029738:0:17596:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9bd07b2319b8) has exports, disconnecting them 00000020:00080000:2.0:1788836444.029742:0:17596:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9bd047f48800), last request at 1788836365 00000020:00000080:2.0:1788836444.029747:0:17596:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a48d 00000020:00080000:2.0:1788836444.029755:0:17596:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd047f48800): rc 0 00000020:00000080:2.0:1788836444.029761:0:17596:0:(genops.c:885:class_export_put()) final put ffff9bd047f48800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788836444.029920:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd047f4b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788836444.029949:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd047f48800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788836444.040479:0:17596:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788836444.040487:0:17596:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788836444.040491:0:17596:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788836444.040497:0:17596:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788836444.040688:0:17596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836444.040706:0:17596:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1788836444.040713:0:17596:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd04ea62000 1 00000020:00000080:0.0:1788836444.040720:0:17596:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a432 00000020:00000080:0.0:1788836444.040728:0:17596:0:(genops.c:885:class_export_put()) final put ffff9bd04ebfa800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788836444.040734:0:17596:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788836444.040741:0:17596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788836444.040746:0:17596:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788836444.040749:0:17596:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9bd044d019b8) has no exports 00000020:00000080:1.0:1788836444.041040:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd043066000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788836444.041047:0:8:0:(genops.c:885:class_export_put()) final put ffff9bd047f48000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788836444.041050:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd047f48000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788836444.041058:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788836444.041107:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd04ebfa800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788836444.089825:0:17596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836444.089840:0:17596:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788836444.089846:0:17596:0:(genops.c:885:class_export_put()) final put ffff9bd07ae70800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788836444.089851:0:17596:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07ae70800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788836444.089861:0:17596:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788836444.089994:0:17596:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bd07ae71000 00000020:02000400:0.0:1788836444.090032:0:17596:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788836444.880597:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836445.904589:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788836446.393753:0:17747:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788836446.413506:0:17747:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788836446.413583:0:17747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047998a00/0xcb5b7bc40b90a5b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a5ba expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836446.413598:0:17747:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047998a00/0xcb5b7bc40b90a5b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90a5ba expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836446.413604:0:17747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047998a00/0xcb5b7bc40b90a5b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b90a5ba expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836446.413623:0:17747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9bd047998a00/0xcb5b7bc40b90a5b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b90a5ba expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836446.413649:0:17747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788836446.413653:0:17747:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788836446.413683:0:17747:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788836446.413693:0:17747:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd07a358a80 x1875730538542848/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836448 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836446.413709:0:17747:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd07a3dce00 x1875730538543360/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836453 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836446.413724:0:17747:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd07a35b800 x1875730538543488/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836454 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836446.413735:0:17747:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd07a358000 x1875730538543616/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836459 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836446.413744:0:17747:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd07ad00e00 x1875730538543872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836459 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836446.413752:0:17747:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788836446.413757:0:17747:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788836446.413779:0:17747:0:(import.c:65:import_set_state_nolock()) ffff9bcf479b2000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788836446.413904:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875730538542848:0@lo:400:kworker.0 00000100:00100000:1.0:1788836446.413935:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875730538543616:0@lo:400:kworker.0 00000100:00100000:1.0:1788836446.413941:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a35b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875730538543488:0@lo:400:kworker.0 00010000:00010000:0.0:1788836446.414069:0:14291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836446.414076:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd047998a00/0xcb5b7bc40b90a5b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b90a5ba expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836446.414084:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998a00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:0.0:1788836446.414088:0:14291:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd047998a00/0xcb5b7bc40b90a5b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b90a5ba expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836446.414096:0:14291:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd047998a00/0xcb5b7bc40b90a5b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb5b7bc40b90a5ba expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836446.414109:0:14291:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd047998a00/0xcb5b7bc40b90a5b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb5b7bc40b90a5ba expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836446.414114:0:14291:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788836446.414117:0:14291:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788836446.414119:0:14291:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788836446.414131:0:14291:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd07ae76800 00010000:00010000:0.0:1788836446.414135:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd047998a00/0xcb5b7bc40b90a5b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb5b7bc40b90a5ba expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836446.414141:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd047998a00/0xcb5b7bc40b90a5b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb5b7bc40b90a5ba expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836446.414151:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836446.414153:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836446.414154:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836446.414235:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875730538543872:0@lo:400:kworker.0 00000100:00100000:2.0:1788836446.414242:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875730538543360:0@lo:400:kworker.0 00000100:00100000:2.0:1788836446.414274:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1875730538544000:0@lo:39:umount.0 00000400:00000100:2.0:1788836446.414322:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730538544000 offset 0 length 224: 4 00010000:00010000:1.0:1788836446.934245:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836447.953737:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836448.985207:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788836449.105059:0:15891:0:(pinger.c:229:ptlrpc_pinger_process_import()) e8cc5c45-b703-4cf0-83fd-6722cde04691->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788836449.105067:0:15891:0:(pinger.c:247:ptlrpc_pinger_process_import()) e8cc5c45-b703-4cf0-83fd-6722cde04691->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788836450.000586:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836451.026926:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836452.056956:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836453.073337:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836454.100426:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788836454.225788:0:15891:0:(pinger.c:229:ptlrpc_pinger_process_import()) e8cc5c45-b703-4cf0-83fd-6722cde04691->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788836454.225801:0:15891:0:(pinger.c:247:ptlrpc_pinger_process_import()) e8cc5c45-b703-4cf0-83fd-6722cde04691->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788836455.121215:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836456.145602:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836456.656703:0:3301:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836446/real 1788836446] req@ffff9bd07ad00380 x1875730538544000/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788836456 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836456.656735:0:3301:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd07ad00380 x1875730538544000/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788836456 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788836456.656753:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bcf479b2000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788836456.656774:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1875730538544000:0@lo:39:umount.0 00000100:00080000:3.0:1788836456.656869:0:17747:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788836456.656874:0:17747:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788836456.656879:0:17747:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788836456.657757:0:17747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047998e00/0xcb5b7bc40b90a589 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a590 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836456.657771:0:17747:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047998e00/0xcb5b7bc40b90a589 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90a590 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836456.657790:0:17747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047998e00/0xcb5b7bc40b90a589 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b90a590 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836456.657797:0:17747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9bd047998e00/0xcb5b7bc40b90a589 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b90a590 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836456.657822:0:17747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836456.657829:0:17747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd07978b600/0xcb5b7bc40b90a742 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a749 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836456.657835:0:17747:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd07978b600/0xcb5b7bc40b90a742 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90a749 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836456.657841:0:17747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd07978b600/0xcb5b7bc40b90a742 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b90a749 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836456.657847:0:17747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9bd07978b600/0xcb5b7bc40b90a742 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b90a749 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836456.657866:0:17747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788836456.657870:0:17747:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788836456.657891:0:17747:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788836456.657895:0:17747:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788836456.657900:0:17747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788836456.657905:0:17747:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788836456.657909:0:17747:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9bd0482ccd28) has no exports 00000020:00080000:3.0:1788836456.657932:0:17747:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9bd0482ccd28) has no exports 00000020:01000000:3.0:1788836456.659537:0:17747:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd0430f0900 - data ffff9bd066382438/ffff9bcf4667bc00 00000020:01000000:3.0:1788836456.659676:0:17747:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bcf460f0120 - data ffff9bd051b120d8/ffff9bcf45f26400 00010000:00010000:0.0:1788836456.660102:0:14291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788836456.660110:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd047998e00/0xcb5b7bc40b90a589 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b90a590 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836456.660120:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998e00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:0.0:1788836456.660124:0:14291:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd047998e00/0xcb5b7bc40b90a589 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b90a590 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836456.660134:0:14291:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd047998e00/0xcb5b7bc40b90a589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb5b7bc40b90a590 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836456.660154:0:14291:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd047998e00/0xcb5b7bc40b90a589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb5b7bc40b90a590 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836456.660159:0:14291:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788836456.660162:0:14291:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1788836456.660165:0:14291:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1788836456.660201:0:14291:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd07ae76800 00010000:00010000:0.0:1788836456.660205:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd047998e00/0xcb5b7bc40b90a589 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb5b7bc40b90a590 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836456.660211:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd047998e00/0xcb5b7bc40b90a589 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb5b7bc40b90a590 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836456.660221:0:14291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836456.660225:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd07978b600/0xcb5b7bc40b90a742 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b90a749 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836456.660231:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978b600 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:0.0:1788836456.660234:0:14291:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd07978b600/0xcb5b7bc40b90a742 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b90a749 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836456.660240:0:14291:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd07978b600/0xcb5b7bc40b90a742 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb5b7bc40b90a749 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836456.660247:0:14291:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd07978b600/0xcb5b7bc40b90a742 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb5b7bc40b90a749 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836456.660252:0:14291:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788836456.660254:0:14291:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788836456.660261:0:14291:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788836456.660268:0:14291:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd07ae76800 00010000:00010000:0.0:1788836456.660271:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd07978b600/0xcb5b7bc40b90a742 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb5b7bc40b90a749 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836456.660278:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd07978b600/0xcb5b7bc40b90a742 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb5b7bc40b90a749 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836456.660289:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836456.660291:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836456.660293:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836456.660530:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788836456.677562:0:17747:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788836456.716785:0:17747:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a59e 00000020:00000080:3.0:1788836456.716794:0:17747:0:(genops.c:885:class_export_put()) final put ffff9bd047ea6000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788836456.716816:0:17747:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd07af70000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788836456.716820:0:17747:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd07af70000 2 00000020:01000004:3.0:1788836456.716824:0:17747:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bd07af70000 from lustre-OST0001 00000020:00000080:2.0:1788836456.716829:0:15891:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd047ea6000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788836456.716849:0:17747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788836456.716859:0:17747:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788836456.716862:0:17747:0:(genops.c:885:class_export_put()) final put ffff9bd047ea5800/lustre-OST0001_UUID 00000020:00000080:3.0:1788836456.716865:0:17747:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd047ea5800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788836456.716872:0:17747:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788836456.716964:0:17747:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import e8cc5c45-b703-4cf0-83fd-6722cde04691->MGS 00010000:00010000:3.0:1788836456.716980:0:17747:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90a440 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb5b7bc40b90a447 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836456.716992:0:17747:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90a440 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb5b7bc40b90a447 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836456.716999:0:17747:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788836456.717001:0:17747:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788836456.717004:0:17747:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788836456.717017:0:17747:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd07ae76800 00010000:00010000:3.0:1788836456.717021:0:17747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90a440 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb5b7bc40b90a447 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836456.717033:0:17747:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c600/0xcb5b7bc40b90a328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb5b7bc40b90a32f expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836456.717040:0:17747:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c600/0xcb5b7bc40b90a328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb5b7bc40b90a32f expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836456.717059:0:17747:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788836456.717062:0:17747:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788836456.717063:0:17747:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788836456.717073:0:17747:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd07ae76800 00010000:00010000:3.0:1788836456.717076:0:17747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c600/0xcb5b7bc40b90a328 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb5b7bc40b90a32f expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788836456.717093:0:17747:0:(import.c:65:import_set_state_nolock()) ffff9bd07ae76800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788836456.717096:0:17747:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788836456.717098:0:17747:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788836456.717100:0:17747:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788836456.717103:0:17747:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788836456.717112:0:17747:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd07ad01180 x1875730538543744/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788836458 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788836456.717124:0:17747:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788836456.717127:0:17747:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:2.0:1788836456.717177:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e8cc5c45-b703-4cf0-83fd-6722cde04691:3301:1875730538543744:0@lo:250:kworker.0 10000000:01000000:3.0:1788836456.718274:0:17747:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788836456.718288:0:17747:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a313 00000020:00000080:3.0:1788836456.718294:0:17747:0:(genops.c:885:class_export_put()) final put ffff9bd077a6b000/e8cc5c45-b703-4cf0-83fd-6722cde04691 00000020:01000000:3.0:1788836456.718303:0:17747:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.152@tcp (flags='') 00000020:00000080:3.0:1788836456.718307:0:17747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788836456.718312:0:17747:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.152@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788836456.718316:0:17747:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9bd07b2b19b8) has no exports 00000020:00000080:2.0:1788836456.718379:0:15891:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd077a6b000/e8cc5c45-b703-4cf0-83fd-6722cde04691 for MGC192.168.203.152@tcp 10000000:01000000:1.0:1788836456.723808:0:14300:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788836456.723983:0:17747:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.152@tcp: client import never connected 00000100:00080000:3.0:1788836456.723989:0:17747:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788836456.723994:0:17747:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788836456.723998:0:17747:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788836456.724000:0:17747:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788836456.724101:0:17747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788836456.724110:0:17747:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.152@tcp (uuid e8cc5c45-b703-4cf0-83fd-6722cde04691) 00000020:01000000:3.0:1788836456.724118:0:17747:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788836456.724136:0:17747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788836456.724141:0:17747:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788836456.724148:0:17747:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9bd07af70800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788836456.724154:0:17747:0:(genops.c:1553:class_disconnect_exports()) OBD device 17 (ffff9bd0482c8000) has exports, disconnecting them 00000020:00080000:3.0:1788836456.724159:0:17747:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9bd07af70800), last request at 1788836380 00000020:00000080:3.0:1788836456.724163:0:17747:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a5c8 00000020:00080000:3.0:1788836456.724179:0:17747:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd07af70800): rc 0 00000020:00000080:3.0:1788836456.724184:0:17747:0:(genops.c:885:class_export_put()) final put ffff9bd07af70800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788836456.725061:0:15891:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd07ae76800 for MGC192.168.203.152@tcp 00000020:00000080:2.0:1788836456.725071:0:15891:0:(genops.c:885:class_export_put()) final put ffff9bd07ae74800/e8cc5c45-b703-4cf0-83fd-6722cde04691 00000020:00000080:2.0:1788836456.725074:0:15891:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07ae74800/e8cc5c45-b703-4cf0-83fd-6722cde04691 for MGC192.168.203.152@tcp 00000020:01000000:2.0:1788836456.725081:0:15891:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.152@tcp (e8cc5c45-b703-4cf0-83fd-6722cde04691) 00000020:00000080:2.0:1788836456.725385:0:15891:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07af70800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788836456.726594:0:17747:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788836456.726601:0:17747:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788836456.726617:0:17747:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788836456.726623:0:17747:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788836456.726654:0:15891:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bcf479b2000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788836456.726749:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788836456.727048:0:14291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788836456.727222:0:16002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788836456.728517:0:14286:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9bcf46a0a400:14286] 0 exiting: rc = 1 00000100:00100000:1.0:1788836456.728584:0:14287:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9bcf46a0a800:14287] 1 exiting: rc = 0 00000100:00100000:3.0:1788836456.728899:0:15716:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9bcf4681b600:15716] 2 exiting: rc = 0 00000100:00100000:2.0:1788836456.729002:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.729506:0:14290:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9bcf44af4200:14290] 2 exiting: rc = 0 00000100:00100000:0.0:1788836456.729655:0:14289:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9bcf44af4e00:14289] 1 exiting: rc = 0 00000100:00100000:2.0:1788836456.733134:0:16533:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9bd047a5f000:16533] 3 exiting: rc = 0 00000100:00100000:2.0:1788836456.745558:0:14288:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9bcf44af7000:14288] 0 exiting: rc = 1 00000100:00100000:2.0:1788836456.745667:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745675:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745730:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745752:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745758:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745763:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745769:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745774:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745779:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745785:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745789:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745795:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745800:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745806:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745811:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745817:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745822:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745827:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745832:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745838:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745844:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745849:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745854:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745859:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745864:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745869:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745874:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745879:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745884:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745889:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745894:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745899:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745905:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745910:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745915:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745920:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745925:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745930:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745945:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745951:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745956:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745962:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745967:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745971:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745977:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745983:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745988:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745993:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.745998:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.746002:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.746007:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.746012:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.746017:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.746023:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.746028:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.746032:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.746037:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.746042:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.746047:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.746052:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.746058:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.746064:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.746068:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.746073:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788836456.748905:0:17747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788836456.748916:0:17747:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788836456.748921:0:17747:0:(genops.c:885:class_export_put()) final put ffff9bcf479b2800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788836456.748925:0:17747:0:(genops.c:844:class_export_destroy()) destroying export ffff9bcf479b2800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788836456.748931:0:17747:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1788836456.748970:0:17747:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd07af70000 1 00000020:00000080:2.0:1788836456.748975:0:17747:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90a582 00000020:00000080:2.0:1788836456.748981:0:17747:0:(genops.c:885:class_export_put()) final put ffff9bd07941d800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788836456.749003:0:17747:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788836456.749007:0:17747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788836456.749011:0:17747:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788836456.749015:0:17747:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9bd07d3799b8) has no exports 00000020:00000080:1.0:1788836456.750050:0:15891:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07941d800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788836456.779059:0:17747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788836456.779074:0:17747:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788836456.779080:0:17747:0:(genops.c:885:class_export_put()) final put ffff9bd048715800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788836456.779084:0:17747:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd048715800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788836456.779091:0:17747:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788836456.779507:0:17747:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bd07af71000 00000020:01000000:1.0:1788836456.779524:0:17747:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788836456.779528:0:17747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788836456.779532:0:17747:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788836456.779536:0:17747:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9bd0482cb370) has no exports 00000020:00000080:1.0:1788836456.779557:0:17747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788836456.779563:0:17747:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788836456.779566:0:17747:0:(genops.c:885:class_export_put()) final put ffff9bd04ebf8000/OSS_uuid 00000020:00000080:1.0:1788836456.779568:0:17747:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd04ebf8000/OSS_uuid for OSS 00000020:01000000:1.0:1788836456.779572:0:17747:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1788836456.779591:0:14299:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788836456.782213:0:14988:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9bd0481bdc00:14988] 2 exiting: rc = 0 00000100:00100000:2.0:1788836456.782544:0:14985:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9bd07efae600:14985] 0 exiting: rc = 1 00000100:00100000:2.0:1788836456.782599:0:16287:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9bcf4785e400:16287] 3 exiting: rc = 0 00000100:00100000:2.0:1788836456.782703:0:14987:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9bd079808800:14987] 1 exiting: rc = 0 00000100:00100000:1.0:1788836456.782797:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.782805:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.782810:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.782814:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.782819:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.782824:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.782829:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.782833:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.782838:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.782873:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.782879:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.782884:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.782890:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.782895:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.782900:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.782906:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.782911:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.782917:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.782922:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.782926:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.782932:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.782937:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.782942:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.782948:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.782968:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.782973:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.782978:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.782984:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.782989:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.782993:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783000:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783005:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783010:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783015:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783020:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783026:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783031:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783038:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783042:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783047:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783052:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783057:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783061:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783067:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783072:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783077:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783083:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783088:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783093:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783098:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783103:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783109:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783113:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783117:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783122:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783127:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783132:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783137:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783142:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783154:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783159:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783164:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783170:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.783182:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836456.787145:0:14990:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9bd079808000:14990] 1 exiting: rc = 0 00000100:00100000:3.0:1788836456.787216:0:14989:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9bd0445a9800:14989] 0 exiting: rc = 1 00000100:00100000:1.0:1788836456.789030:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789039:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789044:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789050:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789055:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789062:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789068:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789073:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789078:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789083:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789089:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789094:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789100:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789105:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789109:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789115:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789121:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789126:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789131:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789136:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789142:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789147:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789152:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789157:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789161:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789167:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789171:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789176:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789182:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789188:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789205:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789210:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789215:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789220:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789225:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789300:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789305:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789310:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789325:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789331:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789336:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789467:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789476:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789481:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789487:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789492:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789497:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789502:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789507:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789513:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789522:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789527:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789533:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789538:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789544:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789550:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789555:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789560:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789564:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789568:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789573:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789578:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789583:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.789589:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.791187:0:16535:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9bd078fd0800:16535] 3 exiting: rc = 0 00000100:00100000:3.0:1788836456.791691:0:16536:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_004: service thread [ffff9bcf44adba00:16536] 4 exiting: rc = 0 00000100:00100000:3.0:1788836456.791846:0:14992:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9bd042a0ca00:14992] 1 exiting: rc = 0 00000100:00100000:1.0:1788836456.791931:0:14991:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9bd050720e00:14991] 0 exiting: rc = 1 00000100:00100000:0.0:1788836456.792150:0:14993:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9bd042a0d400:14993] 2 exiting: rc = 0 00000100:00100000:0.0:1788836456.792221:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792228:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792233:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792239:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792251:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792260:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792266:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792271:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792276:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792282:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792287:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792292:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792298:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792303:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792308:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792313:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792319:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792324:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792330:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792335:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792379:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792384:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792389:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792395:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792400:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792405:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792411:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792416:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792422:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792442:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792449:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792453:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792458:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792463:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792469:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792474:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792480:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792486:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792491:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792497:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792502:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792508:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792513:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792518:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792524:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792529:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792534:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792540:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792545:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792550:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792555:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792560:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792565:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792586:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792592:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792612:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792619:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792624:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792629:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792634:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792639:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792644:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792657:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.792664:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.800075:0:14994:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9bd042a0c800:14994] 0 exiting: rc = 1 00000100:00100000:1.0:1788836456.802181:0:14995:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9bd042a0c200:14995] 1 exiting: rc = 0 00000100:00100000:0.0:1788836456.803490:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803498:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803503:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803508:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803512:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803518:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803523:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803528:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803533:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803538:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803584:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803593:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803599:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803614:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803619:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803624:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803629:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803633:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803638:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803643:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803648:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803653:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803662:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803666:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803671:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803693:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803699:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803704:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803711:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803716:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803721:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803726:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803732:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803738:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803743:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803748:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803753:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803757:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803762:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803767:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803772:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803777:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803781:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803786:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803806:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803815:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803839:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803846:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803852:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803857:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803862:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803868:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803874:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803878:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803883:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803888:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803892:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803896:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803901:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803906:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803918:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803924:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803928:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.803934:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836456.804951:0:14996:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9bcf452c4000:14996] 0 exiting: rc = 1 00000100:00100000:3.0:1788836456.805080:0:14997:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9bcf452c4a00:14997] 1 exiting: rc = 0 00000100:00100000:0.0:1788836456.805241:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805257:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805276:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805283:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805289:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805296:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805302:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805307:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805312:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805318:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805324:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805329:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805334:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805339:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805495:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805502:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805508:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805514:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805520:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805525:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805531:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805537:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805543:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805548:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805554:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805559:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805580:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805587:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805594:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805600:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805617:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805634:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805639:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805644:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805650:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805655:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805660:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805666:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805685:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805692:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805698:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805704:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805710:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805715:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805723:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805729:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805735:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805741:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805746:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805752:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805772:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805779:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805784:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805797:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805804:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805809:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805814:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805821:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805827:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805832:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805838:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805843:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805849:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836456.805860:0:17747:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788836456.814907:0:17747:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788836474.827187:0:18376:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788836483.886307:0:18836:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788836483.886314:0:18836:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788836483.886488:0:18836:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bcf46073800 00000020:01000004:3.0:1788836483.886505:0:18836:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788836483.886513:0:18836:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788836483.886561:0:18836:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9bd0482ccd28) 00000020:00000080:3.0:1788836483.886576:0:18836:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788836483.911087:0:18836:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788836483.914042:0:18836:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:0.0:1788836483.914791:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:0.0:1788836483.914885:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:0.0:1788836483.914978:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:0.0:1788836483.915280:0:18836:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788836483.915378:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:0.0:1788836483.915563:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:0.0:1788836483.915667:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:0.0:1788836483.915991:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:0.0:1788836483.917849:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 276: rc = 0 00100000:10000000:0.0:1788836483.917937:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 276: rc = 0 00100000:10000000:0.0:1788836483.918649:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 592: rc = 0 00100000:10000000:0.0:1788836483.918962:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 592: rc = 0 00100000:10000000:0.0:1788836483.919265:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 592: rc = 0 00100000:10000000:0.0:1788836483.919934:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 592: rc = 0 00100000:10000000:0.0:1788836483.921401:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 592: rc = 0 00100000:10000000:1.0:1788836483.921863:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 592: rc = 0 00100000:10000000:1.0:1788836483.922113:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 592: rc = 0 00100000:10000000:1.0:1788836483.924652:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 592: rc = 0 00100000:10000000:1.0:1788836483.924903:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 592: rc = 0 00100000:10000000:1.0:1788836483.925108:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 592: rc = 0 00100000:10000000:1.0:1788836483.925400:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 592: rc = 0 00100000:10000000:1.0:1788836483.925659:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 592: rc = 0 00100000:10000000:1.0:1788836483.926076:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 615: rc = 0 00100000:10000000:1.0:1788836483.926304:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 615: rc = 0 00100000:10000000:1.0:1788836483.927037:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 615: rc = 0 00100000:10000000:2.0:1788836483.931932:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 615: rc = 0 00100000:10000000:2.0:1788836483.932249:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 615: rc = 0 00100000:10000000:2.0:1788836483.932660:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 615: rc = 0 00100000:10000000:2.0:1788836483.932940:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 615: rc = 0 00100000:10000000:2.0:1788836483.933768:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 615: rc = 0 00100000:10000000:2.0:1788836483.934050:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 615: rc = 0 00100000:10000000:2.0:1788836483.935173:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 615: rc = 0 00100000:10000000:2.0:1788836483.936869:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 615: rc = 0 00100000:10000000:2.0:1788836483.937716:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 615: rc = 0 00100000:10000000:2.0:1788836483.937961:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 615: rc = 0 00100000:10000000:2.0:1788836483.939585:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 615: rc = 0 00100000:10000000:2.0:1788836483.939897:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 615: rc = 0 00100000:10000000:2.0:1788836483.940129:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 615: rc = 0 00100000:10000000:2.0:1788836483.941805:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 615: rc = 0 00100000:10000000:2.0:1788836483.943823:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 615: rc = 0 00100000:10000000:2.0:1788836483.944094:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 615: rc = 0 00100000:10000000:2.0:1788836483.945792:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 615: rc = 0 00100000:10000000:2.0:1788836483.946087:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 615: rc = 0 00100000:10000000:2.0:1788836483.948084:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 615: rc = 0 00100000:10000000:2.0:1788836483.948603:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 615: rc = 0 00100000:10000000:2.0:1788836483.948872:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 615: rc = 0 00100000:10000000:2.0:1788836483.949141:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 615: rc = 0 00100000:10000000:2.0:1788836483.949986:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 615: rc = 0 00100000:10000000:2.0:1788836483.950626:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 615: rc = 0 00100000:10000000:2.0:1788836483.950896:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 615: rc = 0 00100000:10000000:2.0:1788836483.951556:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 615: rc = 0 00100000:10000000:2.0:1788836483.951830:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 615: rc = 0 00100000:10000000:2.0:1788836483.952104:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 615: rc = 0 00100000:10000000:3.0:1788836483.957136:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 615: rc = 0 00100000:10000000:3.0:1788836483.958590:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 643: rc = 0 00100000:10000000:3.0:1788836483.959096:0:18836:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788836483.959252:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 588: rc = 0 00100000:10000000:3.0:1788836483.960799:0:18836:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788836483.960892:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 588: rc = 0 00100000:10000000:3.0:1788836483.961133:0:18836:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788836483.963832:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 588: rc = 0 00100000:10000000:3.0:1788836483.965722:0:18836:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788836483.965814:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 277: rc = 0 00100000:10000000:3.0:1788836483.966043:0:18836:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788836483.966133:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 277: rc = 0 00100000:10000000:3.0:1788836483.967815:0:18836:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788836483.967905:0:18836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 277: rc = 0 00000020:00000080:3.0:1788836483.969222:0:18836:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788836483.969231:0:18836:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788836483.969243:0:18836:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb5b7bc40b90a9f0 00000020:01000004:3.0:1788836483.969252:0:18836:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788836483.969257:0:18836:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788836483.969262:0:18836:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bcf46073800 from MGS 00000020:01000004:3.0:1788836483.969267:0:18836:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788836483.969278:0:18836:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9bd0482c99b8) 00000020:00000080:3.0:1788836483.969289:0:18836:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788836483.969339:0:18836:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bcf46073800 from MGS, refs=2 00080000:01000000:3.0:1788836483.969417:0:18836:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788836483.969432:0:18836:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb5b7bc40b90a9fe 00000100:00100000:3.0:1788836483.969624:0:18836:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788836483.969780:0:18836:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788836483.969786:0:18836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788836483.970565:0:18836:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788836483.970574:0:18836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788836483.971116:0:18836:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788836483.971303:0:18836:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788836483.971308:0:18836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788836483.971943:0:18836:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788836483.971949:0:18836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788836483.972489:0:18836:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788836483.972496:0:18836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788836483.977468:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836483.977483:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836483.977486:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836483.978900:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836483.978905:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836483.978907:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836483.980092:0:18836:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788836483.984314:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788836484.015547:0:18836:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788836484.015566:0:18836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788836484.015569:0:18836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788836484.020795:0:18846:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788836484.021059:0:18836:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788836484.025436:0:18836:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788836484.026793:0:18836:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788836484.027115:0:18836:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788836484.027769:0:18836:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788836484.027775:0:18836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788836484.044785:0:18836:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788836484.044801:0:18836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788836484.050495:0:18836:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788836484.050510:0:18836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788836484.053676:0:18836:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788836484.053698:0:18836:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.152@tcp' 00000020:01000004:0.0:1788836484.053700:0:18836:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788836484.053730:0:18836:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.152@tcp (typ=mgc) 00000020:00000080:0.0:1788836484.053744:0:18836:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.152@tcp (ffff9bd07d37cd28) 00000020:00000080:0.0:1788836484.053759:0:18836:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788836484.053828:0:18836:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd0453c9000@MGC192.168.203.152@tcp: add connection 192.168.203.152@tcp at head 00010000:00010000:0.0:1788836484.053987:0:18836:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.152@tcp-0 is initialized 00000040:01000000:0.0:1788836484.053994:0:18836:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788836484.054617:0:18851:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788836484.083203:0:18853:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788836484.085071:0:18836:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.152@tcp (uuid cc96480a-9861-42d8-abb0-6f65502ae376) 00000020:00000080:2.0:1788836484.085101:0:18836:0:(genops.c:1385:class_connect()) connect: client cc96480a-9861-42d8-abb0-6f65502ae376, cookie 0xcb5b7bc40b90aa0c 00000100:00080000:2.0:1788836484.085113:0:18836:0:(import.c:510:import_select_connection()) MGC192.168.203.152@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788836484.085120:0:18836:0:(import.c:624:import_select_connection()) MGC192.168.203.152@tcp: import ffff9bd0453c9000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788836484.085165:0:18836:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd07a3dce00 x1875730538544128/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788836484.086552:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cc96480a-9861-42d8-abb0-6f65502ae376:3301:1875730538544128:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788836484.086786:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836484.086861:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538544128 00000100:00100000:2.0:1788836484.086869:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538544128 00000100:00100000:2.0:1788836484.086923:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788836484.086929:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0442c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3301:x1875730538544128:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788836484.088434:0:18847:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from cc96480a-9861-42d8-abb0-6f65502ae376@0@lo t0 exp 0000000000000000 cur 537 last 0 00000020:00000080:2.0:1788836484.088465:0:18847:0:(genops.c:1385:class_connect()) connect: client cc96480a-9861-42d8-abb0-6f65502ae376, cookie 0xcb5b7bc40b90aa13 00000100:00080000:2.0:1788836484.089927:0:18847:0:(import.c:65:import_set_state_nolock()) ffff9bd0653ec800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788836484.090431:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0442c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+5:3301:x1875730538544128:12345-0@lo:250:mount.lustre.0 Request processed in 3489us (3634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836484.090442:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788836484.090498:0:18836:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import cc96480a-9861-42d8-abb0-6f65502ae376->MGS 00000020:01000004:2.0:1788836484.090525:0:18836:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788836484.090533:0:18836:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788836484.090547:0:18836:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9bd044d04d28) 00000020:00000080:2.0:1788836484.090559:0:18836:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788836484.101467:0:3301:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.152@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788836484.101492:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.152@tcp: connect to target with instance 0 00000100:00080000:0.0:1788836484.101502:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.152@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788836484.101508:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788836484.102696:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd0453c9000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788836484.102705:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788836484.102721:0:3301:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788836484.102731:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cc96480a-9861-42d8-abb0-6f65502ae376:3301:1875730538544128:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788836484.107730:0:18836:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788836484.107940:0:18836:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788836484.107953:0:18836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788836484.112761:0:18836:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788836484.112776:0:18836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788836484.115967:0:18836:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788836484.115979:0:18836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788836484.117038:0:18836:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788836484.117315:0:18836:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788836484.117320:0:18836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788836484.118248:0:18836:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788836484.118258:0:18836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788836484.182813:0:18836:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788836484.183036:0:18836:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788836484.183042:0:18836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788836484.185454:0:18836:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788836484.185467:0:18836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788836484.186023:0:18836:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788836484.186223:0:18836:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788836484.186228:0:18836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788836484.190247:0:18836:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788836484.190259:0:18836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788836484.191316:0:18836:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788836484.191536:0:18836:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788836484.191541:0:18836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788836484.210803:0:18836:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788836484.210818:0:18836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788836484.211900:0:18836:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788836484.212083:0:18836:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788836484.212097:0:18836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788836484.212604:0:18836:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788836484.212611:0:18836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788836484.245339:0:18836:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788836484.245622:0:18836:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788836484.245629:0:18836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788836484.247772:0:18836:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788836484.247785:0:18836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788836484.250403:0:18836:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788836484.250417:0:18836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788836484.251281:0:18836:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788836484.251305:0:18836:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788836484.251312:0:18836:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788836484.251653:0:18836:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788836484.251685:0:18836:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.152@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788836484.251689:0:18836:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788836484.251690:0:18836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788836484.251692:0:18836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836484.251693:0:18836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836484.251694:0:18836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836484.251695:0:18836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836484.251697:0:18836:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788836484.251698:0:18836:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788836484.251700:0:18836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836484.251702:0:18836:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788836484.251705:0:18836:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788836484.251707:0:18836:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788836484.251708:0:18836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788836484.251709:0:18836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836484.251710:0:18836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836484.251711:0:18836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836484.251716:0:18836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836484.251717:0:18836:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788836484.251718:0:18836:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788836484.251719:0:18836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836484.251720:0:18836:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788836484.251745:0:18836:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788836484.251763:0:18836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad03100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:18836:1875730538544256:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788836484.251843:0:18836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836484.251940:0:18836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0516bf0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836484.252321:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538544256 00000100:00100000:0.0:1788836484.252329:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538544256 00000100:00100000:1.0:1788836484.260435:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788836484.260454:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45b7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+5:18836:x1875730538544256:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788836484.260504:0:18849:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788836484.260507:0:18849:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788836484.260510:0:18849:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788836484.264518:0:18871:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788836484.265066:0:18849:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 8 20000000:01000000:3.0:1788836484.270294:0:18872:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788836484.270303:0:18872:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788836484.270306:0:18872:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788836484.270553:0:18872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788836484.271755:0:18849:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788836484.271769:0:18849:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788836484.292795:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45b7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+5:18836:x1875730538544256:12345-0@lo:253:mount.lustre.0 Request processed in 32339us (40945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836484.292808:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836484.292810:0:18836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad03100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:18836:1875730538544256:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788836484.292824:0:18836:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788836484.292827:0:18836:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788836484.292829:0:18836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788836484.292830:0:18836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836484.292831:0:18836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836484.292832:0:18836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836484.292834:0:18836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836484.292835:0:18836:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788836484.292836:0:18836:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788836484.292838:0:18836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836484.292839:0:18836:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788836484.292859:0:18836:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bcf46073800 from lustre-MDT0000 10000000:01000000:3.0:1788836484.292883:0:18836:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788836484.292887:0:18836:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788836484.292891:0:18836:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9bd07d37cd28 10000000:01000000:3.0:1788836484.292896:0:18836:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788836484.292903:0:18836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9bd07d37cd28 from 1 10000000:01000000:3.0:1788836484.292906:0:18836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788836484.292944:0:18836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040031a00/0xcb5b7bc40b90aa21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836484.292971:0:18836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd040031a00/0xcb5b7bc40b90aa21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836484.292981:0:18836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd040031a00/0xcb5b7bc40b90aa21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836484.293000:0:18836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad03100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:18836:1875730538544384:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788836484.293036:0:18836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836484.293072:0:18836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0516bf900 going to sleep for 11 seconds 00000100:00100000:2.0:1788836484.293127:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538544384 00000100:00100000:2.0:1788836484.293133:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538544384 00000100:00100000:2.0:1788836484.293174:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788836484.293182:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45b7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+5:18836:x1875730538544384:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788836484.293194:0:18847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836484.293209:0:18847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd07efb2000/0xcb5b7bc40b90aa28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90aa21 expref: -99 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836484.293557:0:18847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd07efb2000/0xcb5b7bc40b90aa28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90aa21 expref: 6 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836484.293570:0:18847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd07efb2000/0xcb5b7bc40b90aa28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90aa21 expref: 6 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836484.293579:0:18847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07efb2000, rc 0) 00000100:00100000:2.0:1788836484.293625:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45b7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+6:18836:x1875730538544384:12345-0@lo:101:mount.lustre.0 Request processed in 443us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836484.293631:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788836484.293769:0:18836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad03100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:18836:1875730538544384:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788836484.293782:0:18836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd040031a00/0xcb5b7bc40b90aa21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90aa28 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836484.293791:0:18836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd040031a00/0xcb5b7bc40b90aa21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90aa28 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836484.293838:0:18836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad03100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:18836:1875730538544512:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788836484.293862:0:18836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836484.293879:0:18836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0516bf900 going to sleep for 11 seconds 00000100:00100000:0.0:1788836484.294035:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538544512 00000100:00100000:0.0:1788836484.294040:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538544512 00000100:00100000:0.0:1788836484.294078:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788836484.294085:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45b7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+6:18836:x1875730538544512:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836484.294325:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45b7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+6:18836:x1875730538544512:12345-0@lo:501:mount.lustre.0 Request processed in 240us (461us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788836484.294333:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788836484.294360:0:18836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad03100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:18836:1875730538544512:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788836484.294397:0:18836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788836484.294407:0:18836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040031a00/0xcb5b7bc40b90aa21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90aa28 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836484.294415:0:18836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd040031a00/0xcb5b7bc40b90aa21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90aa28 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836484.294444:0:18836:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bcf46073800 10000000:01000000:3.0:1788836484.294447:0:18836:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788836484.294451:0:18836:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9bcf46073800 10000000:01000000:3.0:1788836484.294453:0:18836:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788836484.294456:0:18836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9bcf46073800 from 1 10000000:01000000:3.0:1788836484.294458:0:18836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788836484.294599:0:18836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040030600/0xcb5b7bc40b90aa2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836484.294607:0:18836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd040030600/0xcb5b7bc40b90aa2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836484.294617:0:18836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd040030600/0xcb5b7bc40b90aa2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836484.294631:0:18836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad03100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:18836:1875730538544640:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788836484.294659:0:18836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836484.294691:0:18836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0516bf900 going to sleep for 11 seconds 00000100:00100000:0.0:1788836484.294797:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538544640 00000100:00100000:0.0:1788836484.294802:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538544640 00000100:00100000:0.0:1788836484.294836:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788836484.294843:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45b7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+6:18836:x1875730538544640:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788836484.294852:0:18847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836484.294866:0:18847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd08217da00/0xcb5b7bc40b90aa36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90aa2f expref: -99 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.294883:0:18847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd08217da00/0xcb5b7bc40b90aa36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90aa2f expref: 7 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.294892:0:18847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd08217da00/0xcb5b7bc40b90aa36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90aa2f expref: 7 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.294911:0:18847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217da00, rc 0) 00000100:00100000:0.0:1788836484.295021:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45b7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+7:18836:x1875730538544640:12345-0@lo:101:mount.lustre.0 Request processed in 178us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836484.295028:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788836484.296659:0:18836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad03100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:18836:1875730538544640:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788836484.296681:0:18836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd040030600/0xcb5b7bc40b90aa2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90aa36 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836484.296693:0:18836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd040030600/0xcb5b7bc40b90aa2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90aa36 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836484.296714:0:18836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788836484.296730:0:18836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040030600/0xcb5b7bc40b90aa2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90aa36 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836484.296752:0:18836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd040030600/0xcb5b7bc40b90aa2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90aa36 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836484.296759:0:18836:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788836484.296851:0:18836:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788836484.296858:0:18836:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9bcf46073800 10000000:01000000:2.0:1788836484.296861:0:18836:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788836484.296866:0:18836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788836484.296869:0:18836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788836484.296901:0:18836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd07efb2c00/0xcb5b7bc40b90aa3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836484.296909:0:18836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd07efb2c00/0xcb5b7bc40b90aa3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836484.296918:0:18836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd07efb2c00/0xcb5b7bc40b90aa3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836484.296935:0:18836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:18836:1875730538544768:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788836484.296986:0:18836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836484.297027:0:18836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0517df480 going to sleep for 11 seconds 00000100:00100000:1.0:1788836484.297093:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538544768 00000100:00100000:1.0:1788836484.297099:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538544768 00000100:00100000:1.0:1788836484.297157:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788836484.297166:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45b7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+7:18836:x1875730538544768:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836484.297178:0:18850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836484.297190:0:18850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd07978ba00/0xcb5b7bc40b90aa44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90aa3d expref: -99 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836484.297210:0:18850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd07978ba00/0xcb5b7bc40b90aa44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90aa3d expref: 8 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836484.297220:0:18850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd07978ba00/0xcb5b7bc40b90aa44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90aa3d expref: 8 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836484.297558:0:18850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978ba00, rc 0) 00000100:00100000:1.0:1788836484.297648:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45b7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+8:18836:x1875730538544768:12345-0@lo:101:mount.lustre.0 Request processed in 482us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836484.297655:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788836484.301721:0:18836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:18836:1875730538544768:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788836484.301753:0:18836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd07efb2c00/0xcb5b7bc40b90aa3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90aa44 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836484.301767:0:18836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd07efb2c00/0xcb5b7bc40b90aa3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90aa44 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836484.301854:0:18836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:18836:1875730538544896:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836484.301914:0:18836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836484.301972:0:18836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0517df480 going to sleep for 11 seconds 00000100:00100000:0.0:1788836484.301991:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538544896 00000100:00100000:0.0:1788836484.301998:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538544896 00000100:00100000:0.0:1788836484.302049:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788836484.302058:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45b7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+8:18836:x1875730538544896:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836484.302722:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45b7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+9:18836:x1875730538544896:12345-0@lo:501:mount.lustre.0 Request processed in 664us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836484.302731:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788836484.303340:0:18836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:18836:1875730538544896:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836484.303565:0:18836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:18836:1875730538545024:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788836484.303620:0:18836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836484.303706:0:18836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0517df480 going to sleep for 11 seconds 00000100:00100000:1.0:1788836484.305836:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538545024 00000100:00100000:1.0:1788836484.305850:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538545024 00000100:00100000:1.0:1788836484.305910:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788836484.305920:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45b7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+9:18836:x1875730538545024:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788836484.306642:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45b7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+9:18836:x1875730538545024:12345-0@lo:503:mount.lustre.0 Request processed in 721us (3019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836484.306652:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788836484.306957:0:18836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:18836:1875730538545024:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788836484.307318:0:18873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc96480a-9861-42d8-abb0-6f65502ae376:18873:1875730538545152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788836484.307397:0:18873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836484.307434:0:18873:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07af943c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836484.307629:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538545152 00000100:00100000:0.0:1788836484.307635:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538545152 00000100:00100000:0.0:1788836484.307672:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788836484.307680:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45b7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+9:18873:x1875730538545152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836484.307950:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45b7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+9:18873:x1875730538545152:12345-0@lo:502:llog_process_th.0 Request processed in 270us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836484.307958:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788836484.308041:0:18873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc96480a-9861-42d8-abb0-6f65502ae376:18873:1875730538545152:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788836484.308064:0:18873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836484.308075:0:18873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836484.308078:0:18873:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788836484.308083:0:18873:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788836484.308086:0:18873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788836484.308100:0:18873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9bd0482cb370) 00000020:00000080:3.0:1788836484.308116:0:18873:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788836484.308120:0:18873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788836484.308178:0:18873:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788836484.308185:0:18873:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb5b7bc40b90aa52 00000020:00000080:3.0:1788836484.308431:0:18873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788836484.308436:0:18873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836484.308439:0:18873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836484.308441:0:18873:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788836484.308443:0:18873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836484.308446:0:18873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836484.308447:0:18873:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788836484.308450:0:18873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788836484.308456:0:18873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9bd0482c8000) 00000020:00000080:3.0:1788836484.308466:0:18873:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788836484.308653:0:18873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788836484.308656:0:18873:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788836484.308658:0:18873:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788836484.308665:0:18873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788836484.308707:0:18873:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bcf46073800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788836484.308735:0:18873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9bd07acd19b8) 00000020:00000080:3.0:1788836484.308744:0:18873:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788836484.308790:0:18873:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788836484.308797:0:18873:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcb5b7bc40b90aa67 00000020:00000080:3.0:1788836484.308884:0:18873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788836484.308889:0:18873:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788836484.308893:0:18873:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcb5b7bc40b90aa6e 00080000:01000000:3.0:1788836484.308898:0:18873:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788836484.308902:0:18873:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb5b7bc40b90aa75 00010000:00010000:2.0:1788836484.430285:0:18873:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788836484.439714:0:18873:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:3.0:1788836484.439941:0:18873:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788836484.440756:0:18873:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9bd07acd3370) 00000020:00000080:3.0:1788836484.440776:0:18873:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788836484.440832:0:18873:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788836484.440842:0:18873:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb5b7bc40b90aa83 00000020:00000080:3.0:1788836484.451571:0:18873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788836484.464949:0:18873:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcb5b7bc40b90aa8a 00000020:00000080:2.0:1788836484.469635:0:18873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788836484.469652:0:18873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836484.470444:0:18873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836484.470449:0:18873:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788836484.470456:0:18873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836484.470463:0:18873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836484.470464:0:18873:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788836484.470468:0:18873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788836484.470524:0:18873:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788836484.470543:0:18873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836484.470547:0:18873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836484.470548:0:18873:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788836484.470550:0:18873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788836484.470552:0:18873:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:2.0:1788836484.470555:0:18873:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788836484.470556:0:18873:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788836484.470557:0:18873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788836484.470559:0:18873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836484.470561:0:18873:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788836484.470563:0:18873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788836484.470566:0:18873:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788836484.470569:0:18873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836484.470570:0:18873:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788836484.470587:0:18873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788836484.470593:0:18873:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:2.0:1788836484.470620:0:18873:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788836484.470622:0:18873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788836484.470637:0:18873:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9bd044d019b8) 00000020:00000080:2.0:1788836484.470656:0:18873:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788836484.470661:0:18873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788836484.470717:0:18873:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788836484.470722:0:18873:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788836484.470728:0:18873:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb5b7bc40b90aa98 00010000:00080000:2.0:1788836484.470762:0:18873:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd07b264800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:2.0:1788836484.470992:0:18873:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1788836484.478915:0:18873:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788836484.478961:0:18873:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788836484.482706:0:18873:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788836484.482779:0:18873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1788836484.482859:0:18873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:1.0:1788836484.491081:0:18877:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788836484.491090:0:18877:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788836484.494887:0:18873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788836484.494902:0:18873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788836484.494941:0:18873:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788836484.494959:0:18873:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcb5b7bc40b90aa9f 00000100:00080000:3.0:1788836484.494969:0:18873:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788836484.494975:0:18873:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bd07b264800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788836484.495006:0:18873:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd07ad03100 x1875730538545280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788836484.495034:0:18873:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788836484.495093:0:18873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836484.495096:0:18873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836484.495098:0:18873:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788836484.495101:0:18873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788836484.495103:0:18873:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1788836484.495112:0:18873:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788836484.495114:0:18873:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788836484.495115:0:18873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788836484.495118:0:18873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836484.495119:0:18873:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788836484.495122:0:18873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788836484.495126:0:18873:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788836484.495129:0:18873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836484.495130:0:18873:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788836484.495132:0:18873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788836484.495136:0:18873:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:3.0:1788836484.495158:0:18873:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788836484.495160:0:18873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788836484.495170:0:18873:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9bd07acd4d28) 00000020:00000080:3.0:1788836484.495190:0:18873:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788836484.495194:0:18873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788836484.495256:0:18873:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788836484.495262:0:18873:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788836484.495266:0:18873:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb5b7bc40b90aaad 00010000:00080000:3.0:1788836484.495297:0:18873:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd07af71000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1788836484.495514:0:18873:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788836484.495703:0:18873:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788836484.495723:0:18873:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788836484.496247:0:18873:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788836484.496317:0:18873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1788836484.496435:0:18873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000100:00100000:0.0:1788836484.496724:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538545280:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788836484.496779:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875730538545280 offset 0 length 520: 4 00000040:00080000:0.0:1788836484.497729:0:18879:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788836484.497739:0:18879:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788836484.499638:0:18873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788836484.499653:0:18873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788836484.499694:0:18873:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788836484.499715:0:18873:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcb5b7bc40b90aab4 00000100:00080000:2.0:1788836484.499725:0:18873:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788836484.499731:0:18873:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bd07af71000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788836484.499766:0:18873:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd07a3ded80 x1875730538545408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788836484.499785:0:18873:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788836484.499894:0:18873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836484.499897:0:18873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836484.499899:0:18873:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788836484.499901:0:18873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836484.499905:0:18873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836484.499906:0:18873:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788836484.499909:0:18873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788836484.499910:0:18873:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788836484.499912:0:18873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836484.499924:0:18873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836484.499925:0:18873:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788836484.499928:0:18873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836484.499931:0:18873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836484.499932:0:18873:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788836484.499935:0:18873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788836484.499966:0:18873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc96480a-9861-42d8-abb0-6f65502ae376:18873:1875730538545536:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836484.500133:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538545408:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788836484.500209:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875730538545408 offset 0 length 520: 4 00000100:00100000:2.0:1788836484.500337:0:18873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836484.500417:0:18873:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0517dfc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788836484.504085:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538545536 00000100:00100000:0.0:1788836484.504533:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538545536 00000100:00100000:0.0:1788836484.504638:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788836484.504650:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45b7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+9:18873:x1875730538545536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836484.504942:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45b7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+9:18873:x1875730538545536:12345-0@lo:502:llog_process_th.0 Request processed in 294us (4604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836484.504950:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788836484.505052:0:18873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc96480a-9861-42d8-abb0-6f65502ae376:18873:1875730538545536:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788836484.505087:0:18873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836484.505095:0:18873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836484.505109:0:18873:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788836484.505114:0:18873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788836484.505722:0:18836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1788836484.505743:0:18836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788836484.505768:0:18836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd07efb2c00/0xcb5b7bc40b90aa3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90aa44 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836484.505779:0:18836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd07efb2c00/0xcb5b7bc40b90aa3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90aa44 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836484.505798:0:18836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bcf46073800 from 1 10000000:01000000:3.0:1788836484.505801:0:18836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788836484.505832:0:18836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040030000/0xcb5b7bc40b90aabb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836484.505839:0:18836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd040030000/0xcb5b7bc40b90aabb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836484.505849:0:18836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd040030000/0xcb5b7bc40b90aabb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836484.505867:0:18836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad03480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:18836:1875730538545664:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788836484.505911:0:18836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836484.507072:0:18836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd04577b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788836484.507524:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538545664 00000100:00100000:2.0:1788836484.507532:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538545664 00000100:00100000:2.0:1788836484.507576:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788836484.507584:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45b7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+9:18836:x1875730538545664:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788836484.507599:0:18847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836484.507617:0:18847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd07efb2a00/0xcb5b7bc40b90aac2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90aabb expref: -99 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836484.507643:0:18847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd07efb2a00/0xcb5b7bc40b90aac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90aabb expref: 10 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836484.507653:0:18847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd07efb2a00/0xcb5b7bc40b90aac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90aabb expref: 10 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836484.507661:0:18847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07efb2a00, rc 0) 00000100:00100000:2.0:1788836484.507706:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45b7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+10:18836:x1875730538545664:12345-0@lo:101:mount.lustre.0 Request processed in 123us (1795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836484.507712:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788836484.507808:0:18836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad03480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:18836:1875730538545664:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788836484.507822:0:18836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd040030000/0xcb5b7bc40b90aabb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90aac2 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836484.507832:0:18836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd040030000/0xcb5b7bc40b90aabb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90aac2 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836484.508490:0:18836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad03480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:18836:1875730538545792:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788836484.508536:0:18836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836484.508573:0:18836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd04577b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788836484.508675:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538545792 00000100:00100000:2.0:1788836484.508680:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538545792 00000100:00100000:2.0:1788836484.508705:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788836484.508720:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45b7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+10:18836:x1875730538545792:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788836484.508736:0:18847:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788836484.508742:0:18847:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788836484.508809:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45b7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+10:18836:x1875730538545792:12345-0@lo:256:mount.lustre.0 Request processed in 90us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836484.508815:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788836484.509108:0:18836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad03480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:18836:1875730538545792:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788836484.509950:0:18836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788836484.510010:0:18836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040030000/0xcb5b7bc40b90aabb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90aac2 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836484.510022:0:18836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd040030000/0xcb5b7bc40b90aabb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90aac2 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836484.510030:0:18836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bcf46073800 from 1 10000000:01000000:3.0:1788836484.510033:0:18836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788836484.510065:0:18836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040031400/0xcb5b7bc40b90aac9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836484.510073:0:18836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd040031400/0xcb5b7bc40b90aac9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836484.510083:0:18836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd040031400/0xcb5b7bc40b90aac9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836484.510501:0:18836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad03480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:18836:1875730538545920:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788836484.510555:0:18836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836484.510582:0:18836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd04577b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788836484.510952:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538545920 00000100:00100000:2.0:1788836484.510961:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538545920 00000100:00100000:2.0:1788836484.510998:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788836484.511006:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45b7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+10:18836:x1875730538545920:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788836484.511020:0:18847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836484.511037:0:18847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd07efb2600/0xcb5b7bc40b90aad0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90aac9 expref: -99 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836484.511062:0:18847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd07efb2600/0xcb5b7bc40b90aad0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90aac9 expref: 11 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836484.511071:0:18847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd07efb2600/0xcb5b7bc40b90aad0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90aac9 expref: 11 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836484.511079:0:18847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07efb2600, rc 0) 00000100:00100000:2.0:1788836484.511310:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45b7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+11:18836:x1875730538545920:12345-0@lo:101:mount.lustre.0 Request processed in 296us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836484.511317:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788836484.514296:0:18836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad03480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:18836:1875730538545920:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788836484.514337:0:18836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd040031400/0xcb5b7bc40b90aac9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90aad0 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836484.514616:0:18836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd040031400/0xcb5b7bc40b90aac9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90aad0 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836484.514776:0:18836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:18836:1875730538546048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836484.514836:0:18836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836484.514884:0:18836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046706000 going to sleep for 11 seconds 00000100:00100000:3.0:1788836484.514953:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538546048 00000100:00100000:3.0:1788836484.514960:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538546048 00000100:00100000:3.0:1788836484.514997:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788836484.515018:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45b7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+11:18836:x1875730538546048:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788836484.515712:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45b7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+11:18836:x1875730538546048:12345-0@lo:501:mount.lustre.0 Request processed in 692us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836484.515721:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788836484.515832:0:18836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:18836:1875730538546048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836484.515879:0:18836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:18836:1875730538546176:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788836484.515919:0:18836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836484.515949:0:18836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046706000 going to sleep for 11 seconds 00000100:00100000:3.0:1788836484.516506:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538546176 00000100:00100000:3.0:1788836484.516514:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538546176 00000100:00100000:3.0:1788836484.516548:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788836484.516557:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45b7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+11:18836:x1875730538546176:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788836484.516749:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45b7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+11:18836:x1875730538546176:12345-0@lo:503:mount.lustre.0 Request processed in 192us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836484.516757:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788836484.516948:0:18836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:18836:1875730538546176:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788836484.517871:0:18881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc96480a-9861-42d8-abb0-6f65502ae376:18881:1875730538546304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836484.517931:0:18881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836484.517973:0:18881:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0467063c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836484.518029:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538546304 00000100:00100000:3.0:1788836484.518035:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538546304 00000100:00100000:3.0:1788836484.518084:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788836484.518093:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45b7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+11:18881:x1875730538546304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788836484.518770:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45b7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+11:18881:x1875730538546304:12345-0@lo:502:llog_process_th.0 Request processed in 676us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836484.518779:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788836484.518893:0:18881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc96480a-9861-42d8-abb0-6f65502ae376:18881:1875730538546304:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788836484.518924:0:18881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836484.518934:0:18881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836484.518936:0:18881:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788836484.518943:0:18881:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bcf46073800 00000020:00000080:2.0:1788836484.518946:0:18881:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788836484.518953:0:18881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836484.518955:0:18881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836484.518956:0:18881:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788836484.518958:0:18881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836484.518960:0:18881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836484.518961:0:18881:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788836484.518965:0:18881:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bcf46073800 00000020:00000080:2.0:1788836484.518967:0:18881:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788836484.519023:0:18881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836484.519027:0:18881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836484.519028:0:18881:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788836484.519031:0:18881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836484.519033:0:18881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836484.519035:0:18881:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788836484.519038:0:18881:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bcf46073800 00000020:00000080:2.0:1788836484.519040:0:18881:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788836484.519091:0:18881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc96480a-9861-42d8-abb0-6f65502ae376:18881:1875730538546432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836484.519138:0:18881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836484.519162:0:18881:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0467063c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836484.519674:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538546432 00000100:00100000:0.0:1788836484.519683:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538546432 00000100:00100000:0.0:1788836484.519715:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788836484.519723:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45b7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+11:18881:x1875730538546432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836484.519914:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45b7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+11:18881:x1875730538546432:12345-0@lo:502:llog_process_th.0 Request processed in 190us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836484.519921:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788836484.520004:0:18881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc96480a-9861-42d8-abb0-6f65502ae376:18881:1875730538546432:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788836484.520026:0:18881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836484.520031:0:18881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836484.520032:0:18881:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788836484.520036:0:18881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788836484.520557:0:18836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788836484.520576:0:18836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788836484.528262:0:18836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040031400/0xcb5b7bc40b90aac9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90aad0 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.528281:0:18836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd040031400/0xcb5b7bc40b90aac9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90aad0 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836484.528364:0:18836:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788836484.528379:0:18836:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bcf46073800 10000000:01000000:0.0:1788836484.528389:0:18836:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bcf46073800 10000000:01000000:0.0:1788836484.528393:0:18836:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788836484.528400:0:18836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bcf46073800 from 1 10000000:01000000:0.0:1788836484.528403:0:18836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788836484.528449:0:18836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd08217ce00/0xcb5b7bc40b90aad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.528458:0:18836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd08217ce00/0xcb5b7bc40b90aad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.528470:0:18836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd08217ce00/0xcb5b7bc40b90aad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836484.528496:0:18836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a359880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:18836:1875730538546560:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788836484.528568:0:18836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836484.528608:0:18836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd079ea1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788836484.528643:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538546560 00000100:00100000:0.0:1788836484.528650:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538546560 00000100:00100000:0.0:1788836484.528694:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788836484.528704:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4502f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+11:18836:x1875730538546560:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788836484.528717:0:18850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836484.528730:0:18850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd08217de00/0xcb5b7bc40b90aade lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90aad7 expref: -99 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.528754:0:18850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd08217de00/0xcb5b7bc40b90aade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90aad7 expref: 12 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.528765:0:18850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd08217de00/0xcb5b7bc40b90aade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90aad7 expref: 12 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.528785:0:18850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217de00, rc 0) 00000100:00100000:0.0:1788836484.528822:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4502f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+12:18836:x1875730538546560:12345-0@lo:101:mount.lustre.0 Request processed in 120us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836484.528829:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788836484.528879:0:18836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a359880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:18836:1875730538546560:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788836484.528892:0:18836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd08217ce00/0xcb5b7bc40b90aad7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90aade expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.528901:0:18836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd08217ce00/0xcb5b7bc40b90aad7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90aade expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836484.528947:0:18836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a359880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:18836:1875730538546688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836484.528971:0:18836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836484.528985:0:18836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd079ea1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788836484.532805:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538546688 00000100:00100000:0.0:1788836484.532819:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538546688 00000100:00100000:0.0:1788836484.532872:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788836484.532882:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4502e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+12:18836:x1875730538546688:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836484.533326:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4502e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+12:18836:x1875730538546688:12345-0@lo:501:mount.lustre.0 Request processed in 443us (4351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836484.533335:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788836484.533564:0:18836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a359880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:18836:1875730538546688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836484.533615:0:18836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a359880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:18836:1875730538546816:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788836484.533664:0:18836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836484.533701:0:18836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd079ea1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788836484.533720:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538546816 00000100:00100000:0.0:1788836484.533725:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538546816 00000100:00100000:0.0:1788836484.533752:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788836484.533759:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4502c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+12:18836:x1875730538546816:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788836484.533920:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4502c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+12:18836:x1875730538546816:12345-0@lo:503:mount.lustre.0 Request processed in 160us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836484.533927:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788836484.533972:0:18836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a359880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:18836:1875730538546816:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788836484.535635:0:18885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc96480a-9861-42d8-abb0-6f65502ae376:18885:1875730538546944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836484.535703:0:18885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836484.535745:0:18885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e70a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788836484.536555:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538546944 00000100:00100000:0.0:1788836484.536564:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538546944 00000100:00100000:0.0:1788836484.536608:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788836484.536617:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4502cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+12:18885:x1875730538546944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836484.536871:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4502cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+12:18885:x1875730538546944:12345-0@lo:502:llog_process_th.0 Request processed in 255us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836484.536879:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788836484.537530:0:18885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc96480a-9861-42d8-abb0-6f65502ae376:18885:1875730538546944:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788836484.537736:0:18885:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788836484.537750:0:18885:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9bd044d00000) 00000020:00000080:2.0:1788836484.537769:0:18885:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1788836484.537855:0:18885:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bcf46073800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788836484.537859:0:18885:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bcf46073800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788836484.537862:0:18885:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bcf46073800 4 00010000:00080000:2.0:1788836484.537892:0:18885:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd078fea800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:2.0:1788836484.540564:0:18885:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1788836484.540758:0:18885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788836484.540798:0:18885:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788836484.540813:0:18885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcb5b7bc40b90aaec 00000100:00080000:2.0:1788836484.540824:0:18885:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788836484.540829:0:18885:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9bd078fea800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788836484.540866:0:18885:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd07a3df480 x1875730538547072/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788836484.540903:0:18885:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788836484.541065:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875730538547072:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788836484.541130:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836484.541282:0:18885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07accad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc96480a-9861-42d8-abb0-6f65502ae376:18885:1875730538547200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788836484.541324:0:18885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836484.541370:0:18885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047ae8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788836484.541393:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538547200 00000100:00100000:1.0:1788836484.541400:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538547200 00000100:00100000:1.0:1788836484.541451:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788836484.541461:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4502f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+12:18885:x1875730538547200:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788836484.541713:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4502f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+12:18885:x1875730538547200:12345-0@lo:502:llog_process_th.0 Request processed in 253us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836484.541721:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788836484.541767:0:18885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07accad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc96480a-9861-42d8-abb0-6f65502ae376:18885:1875730538547200:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788836484.541792:0:18885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:0.0:1788836484.550591:0:18855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538547072 00000100:00100000:0.0:1788836484.550607:0:18855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538547072 00000100:00100000:0.0:1788836484.550657:0:18855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788836484.550667:0:18855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1875730538547072:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788836484.550758:0:18855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1875730538547072:12345-0@lo:38:llog_process_th.0 Request processed in 91us (9626us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788836484.550766:0:18855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788836484.551433:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788836484.551443:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd078fea800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788836484.551447:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788836484.551451:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875730538547072:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1788836484.552562:0:18836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788836484.552596:0:18836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788836484.552620:0:18836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd08217ce00/0xcb5b7bc40b90aad7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90aade expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836484.552632:0:18836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd08217ce00/0xcb5b7bc40b90aad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90aade expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788836484.552690:0:18836:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788836484.552692:0:18836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788836484.552697:0:18836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788836484.552698:0:18836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788836484.552699:0:18836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788836484.552700:0:18836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788836484.552701:0:18836:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788836484.552703:0:18836:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788836484.552704:0:18836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788836484.552705:0:18836:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788836484.552709:0:18836:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788836484.552711:0:18836:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788836484.552712:0:18836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788836484.552713:0:18836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788836484.552714:0:18836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788836484.552715:0:18836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788836484.552716:0:18836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788836484.552717:0:18836:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788836484.552718:0:18836:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788836484.552719:0:18836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788836484.552720:0:18836:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788836484.552745:0:18836:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788836484.552764:0:18836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07accad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:18836:1875730538547328:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788836484.552822:0:18836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836484.552858:0:18836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047ae8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788836484.552972:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538547328 00000100:00100000:0.0:1788836484.552979:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538547328 00000100:00100000:0.0:1788836484.553258:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788836484.553268:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4502e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+12:18836:x1875730538547328:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788836484.553401:0:18849:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788836484.553415:0:18849:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788836484.625398:0:18849:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788836484.625413:0:18849:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788836484.625462:0:18871:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788836484.625467:0:18871:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788836484.625486:0:18871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd08217c400/0xcb5b7bc40b90aaf3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.625503:0:18871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd07efb2a00/0xcb5b7bc40b90aac2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90aabb expref: 12 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.625510:0:18871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd08217c400/0xcb5b7bc40b90aaf3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.625544:0:18871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd07efb2a00/0xcb5b7bc40b90aac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b90aabb expref: 12 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.625556:0:18871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd07efb2a00/0xcb5b7bc40b90aac2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b90aabb expref: 12 pid: 18847 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836484.625568:0:18871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a359880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18871:1875730538547456:0@lo:104: 00000100:00100000:0.0:1788836484.625631:0:18871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836484.625685:0:18871:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd079ea19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836484.625738:0:18838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538547456 00000100:00100000:0.0:1788836484.625745:0:18838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538547456 00000100:00100000:0.0:1788836484.625786:0:18838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788836484.625794:0:18838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a358700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cc96480a-9861-42d8-abb0-6f65502ae376+3:18871:x1875730538547456:12345-0@lo:104: 00010000:00010000:0.0:1788836484.625805:0:18838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd040030000/0xcb5b7bc40b90aabb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90aac2 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.625860:0:18838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788836484.625866:0:18838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a358700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cc96480a-9861-42d8-abb0-6f65502ae376+3:18871:x1875730538547456:12345-0@lo:104: Request processed in 73us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836484.625873:0:18838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788836484.625897:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836484.625903:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd040030000/0xcb5b7bc40b90aabb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90aac2 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.625910:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040030000 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:0.0:1788836484.625914:0:18844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd040030000/0xcb5b7bc40b90aabb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b90aac2 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.625922:0:18844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd040030000/0xcb5b7bc40b90aabb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b90aac2 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836484.625930:0:18844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd040030000/0xcb5b7bc40b90aabb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b90aac2 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836484.625935:0:18844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788836484.625962:0:18844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd040030000/0xcb5b7bc40b90aabb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90aac2 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.625969:0:18844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836484.625988:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd040030000/0xcb5b7bc40b90aabb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90aac2 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.625994:0:18844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd040030000/0xcb5b7bc40b90aabb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90aac2 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.626019:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836484.626021:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836484.626023:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836484.626053:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc96480a-9861-42d8-abb0-6f65502ae376:3303:1875730538547584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836484.626082:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836484.626132:0:18840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538547584 00000100:00100000:0.0:1788836484.626136:0:18840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538547584 00010000:00010000:0.0:1788836484.626151:0:18840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd07efb2a00/0xcb5b7bc40b90aac2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90aabb expref: 13 pid: 18847 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836484.626171:0:18840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788836484.626177:0:18840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a359180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc96480a-9861-42d8-abb0-6f65502ae376+13:3303:x1875730538547584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836484.626186:0:18840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836484.626191:0:18840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd07efb2a00/0xcb5b7bc40b90aac2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90aabb expref: 13 pid: 18847 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.626200:0:18840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd07efb2a00/0xcb5b7bc40b90aac2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b90aabb expref: 13 pid: 18847 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.626214:0:18840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd08217c400/0xcb5b7bc40b90aaf3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.626221:0:18840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd08217c400/0xcb5b7bc40b90aaf3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788836484.626232:0:18840:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000766206s 00010000:00010000:0.0:1788836484.626237:0:18840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd08217c400/0xcb5b7bc40b90aaf3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.626253:0:18840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd08217c400/0xcb5b7bc40b90aaf3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.626260:0:18840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd08217c400/0xcb5b7bc40b90aaf3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.626266:0:18840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd08217c400/0xcb5b7bc40b90aaf3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.626272:0:18840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217c400 already unused, calling callback (ffffffffc1590350) 00010000:00010000:0.0:1788836484.626276:0:18840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd08217c400/0xcb5b7bc40b90aaf3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.626283:0:18840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd08217c400/0xcb5b7bc40b90aaf3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.626293:0:18840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd08217c400/0xcb5b7bc40b90aaf3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.626301:0:18840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836484.626330:0:18840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a359180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc96480a-9861-42d8-abb0-6f65502ae376+13:3303:x1875730538547584:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836484.626337:0:18840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788836484.626399:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc96480a-9861-42d8-abb0-6f65502ae376:3303:1875730538547584:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836484.626439:0:18871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd07efb2a00/0xcb5b7bc40b90aac2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b90aabb expref: 12 pid: 18847 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836484.626449:0:18871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a359880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18871:1875730538547456:0@lo:104: 00010000:00010000:0.0:1788836484.626460:0:18871:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd08217c400/0xcb5b7bc40b90aaf3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.626476:0:18871:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd08217c400/0xcb5b7bc40b90aaf3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.626482:0:18871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd08217c400/0xcb5b7bc40b90aaf3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836484.626488:0:18871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd08217c400/0xcb5b7bc40b90aaf3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836484.665875:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4502e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+11:18836:x1875730538547328:12345-0@lo:253:mount.lustre.0 Request processed in 112598us (113041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836484.665891:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788836484.668476:0:18836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07accad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:18836:1875730538547328:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788836484.668497:0:18836:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788836484.668501:0:18836:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788836484.668502:0:18836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788836484.668504:0:18836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788836484.668505:0:18836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788836484.668506:0:18836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788836484.668507:0:18836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788836484.668508:0:18836:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788836484.668509:0:18836:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788836484.668511:0:18836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788836484.668513:0:18836:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788836484.668532:0:18836:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788836484.677731:0:18836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788836484.677924:0:18836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788836484.678291:0:18836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788836484.678490:0:18836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788836484.680455:0:18836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788836484.680640:0:18836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788836484.681483:0:18836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788836484.681634:0:18836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788836484.681874:0:18836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788836484.682094:0:18836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788836484.682333:0:18836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788836484.683081:0:18836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1788836484.773288:0:18836:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967527 00000040:01000000:2.0:1788836484.773795:0:18836:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788836484.773960:0:18894:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967527 00000020:00080000:1.0:1788836484.773970:0:18894:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000040:01000000:0.0:1788836484.774460:0:18895:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1788836484.774544:0:18895:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788836484.777901:0:18895:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788836484.778783:0:18895:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788836484.778789:0:18895:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1788836484.781082:0:18836:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788836484.781337:0:18836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788836484.782049:0:18836:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788836484.782058:0:18836:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788836484.782436:0:18836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788836484.784237:0:18836:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788836484.785262:0:18836:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788836484.785308:0:18836:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788836484.785876:0:18836:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1788836484.787043:0:18836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:3.0:1788836484.792737:0:18836:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1788836484.826454:0:18836:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788836484.826491:0:18836:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa7ccc1c4f988 00100000:10000000:2.0:1788836484.826499:0:18836:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788836484.834731:0:18836:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788836484.834750:0:18836:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788836484.834773:0:18836:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788836484.834793:0:18836:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1788836485.010387:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788836485.584589:0:18889:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788836485.584598:0:18889:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788836485.585006:0:18889:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788836485.585015:0:18889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:2.0:1788836485.847382:0:18853:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788836485.847389:0:18853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bcf46073800 from 9 10000000:01000000:2.0:1788836485.847393:0:18853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788836485.847448:0:18853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd07efb3000/0xcb5b7bc40b90aafa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836485.847470:0:18853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd07efb3000/0xcb5b7bc40b90aafa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836485.847482:0:18853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd07efb3000/0xcb5b7bc40b90aafa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836485.847816:0:18853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538547712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788836485.854897:0:18853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836485.854956:0:18853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd06901da80 going to sleep for 11 seconds 00000100:00100000:0.0:1788836485.855019:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538547712 00000100:00100000:0.0:1788836485.855028:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538547712 00000100:00100000:0.0:1788836485.855084:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788836485.855093:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4502d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+11:18853:x1875730538547712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836485.855110:0:18850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836485.855129:0:18850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd08217d200/0xcb5b7bc40b90ab01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90aafa expref: -99 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836485.855182:0:18850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd08217d200/0xcb5b7bc40b90ab01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90aafa expref: 12 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836485.855193:0:18850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd08217d200/0xcb5b7bc40b90ab01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90aafa expref: 12 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836485.855323:0:18850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217d200, rc 0) 00000100:00100000:0.0:1788836485.855399:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4502d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+12:18853:x1875730538547712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 307us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836485.855406:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788836485.855598:0:18853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538547712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836485.855614:0:18853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd07efb3000/0xcb5b7bc40b90aafa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90ab01 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836485.855624:0:18853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd07efb3000/0xcb5b7bc40b90aafa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90ab01 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836485.855685:0:18853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538547840:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788836485.855720:0:18853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836485.855750:0:18853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd05431b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836485.855795:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538547840 00000100:00100000:2.0:1788836485.855799:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538547840 00000100:00100000:2.0:1788836485.855832:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788836485.855839:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4502dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+12:18853:x1875730538547840:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788836485.855854:0:18849:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788836485.855867:0:18849:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788836485.855870:0:18849:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1788836485.855944:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4502dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+12:18853:x1875730538547840:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836485.855951:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788836485.856010:0:18853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538547840:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788836485.856049:0:18853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788836485.856056:0:18853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd07efb3000/0xcb5b7bc40b90aafa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90ab01 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836485.856063:0:18853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd07efb3000/0xcb5b7bc40b90aafa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90ab01 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836486.036393:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788836486.608909:0:18889:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788836486.608917:0:18889:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788836486.609623:0:18889:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:3.0:1788836486.609688:0:18889:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788836486.609721:0:18889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:2.0:1788836487.060504:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836488.080514:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836489.105634:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836489.558071:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc96480a-9861-42d8-abb0-6f65502ae376:3304:1875730538547968:0@lo:400:kworker.0 00000100:00100000:2.0:1788836489.558142:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788836489.558215:0:15891:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788836489.558220:0:15891:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788836489.558223:0:15891:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788836489.558226:0:15891:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788836489.558229:0:15891:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788836489.558232:0:15891:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788836489.558235:0:15891:0:(import.c:65:import_set_state_nolock()) ffff9bd078fea800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788836489.558244:0:15891:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9bd078fea800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788836489.558266:0:15891:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd07a358e00 x1875730538548096/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788836489.558313:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875730538548096:0@lo:38:kworker.0 00000100:00100000:0.0:1788836489.558373:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836489.558426:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538548096 00000100:00100000:0.0:1788836489.558434:0:18857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538548096 00000100:00100000:0.0:1788836489.558479:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788836489.558486:0:18857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1875730538548096:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788836489.558587:0:18857:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:0.0:1788836489.558622:0:18857:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcb5b7bc40b90ab08 00000004:00100000:0.0:1788836489.558637:0:18857:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788836489.558769:0:18857:0:(import.c:65:import_set_state_nolock()) ffff9bd048717800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788836489.558819:0:18857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875730538548096:12345-0@lo:38:kworker.0 Request processed in 331us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836489.558826:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788836489.558866:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bd07a358e00 x1875730538548096/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788836499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788836489.558879:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788836489.558886:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788836489.558890:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788836489.558892:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd078fea800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788836489.558897:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875730538548096:0@lo:38:kworker.0 00000100:00100000:3.0:1788836489.563018:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538547968 00000100:00100000:3.0:1788836489.563032:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538547968 00000100:00100000:3.0:1788836489.563093:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788836489.563104:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4502f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+12:3304:x1875730538547968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836489.582523:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4502f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+12:3304:x1875730538547968:12345-0@lo:400:kworker.0 Request processed in 19412us (24370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836489.582537:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788836489.582694:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc96480a-9861-42d8-abb0-6f65502ae376:3304:1875730538547968:0@lo:400:kworker.0 00000001:02000400:2.0:1788836489.926728:0:19137:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788836490.146882:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836491.154557:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836492.176513:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788836493.144956:0:19289:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc6ce9efe0 20000000:00000080:3.0:1788836493.144975:0:19289:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bd0818a7c00 uarg=0000000000000000 20000000:01000000:3.0:1788836493.145010:0:19289:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788836493.145018:0:19289:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788836493.145023:0:19289:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788836493.146593:0:19290:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1788836493.146838:0:19289:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788836493.159496:0:19289:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788836493.159721:0:19289:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd07efb3800/0xcb5b7bc40b90ab0f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836493.159742:0:19289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd07efb2600/0xcb5b7bc40b90aad0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90aac9 expref: 11 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836493.159769:0:19289:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd07efb3800/0xcb5b7bc40b90ab0f lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836493.159819:0:19289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd07efb2600/0xcb5b7bc40b90aad0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b90aac9 expref: 11 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836493.159837:0:19289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd07efb2600/0xcb5b7bc40b90aad0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b90aac9 expref: 11 pid: 18847 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836493.159851:0:19289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19289:1875730538548224:0@lo:104: 00000100:00100000:2.0:1788836493.159923:0:19289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836493.159980:0:19289:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046707f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788836493.160123:0:18839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538548224 00000100:00100000:0.0:1788836493.160130:0:18839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538548224 00000100:00100000:0.0:1788836493.160181:0:18839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788836493.160190:0:18839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc96480a-9861-42d8-abb0-6f65502ae376+3:19289:x1875730538548224:12345-0@lo:104: 00010000:00010000:0.0:1788836493.160202:0:18839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd040031400/0xcb5b7bc40b90aac9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90aad0 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836493.160308:0:18839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788836493.160316:0:18839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc96480a-9861-42d8-abb0-6f65502ae376+3:19289:x1875730538548224:12345-0@lo:104: Request processed in 127us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836493.160323:0:18839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836493.161019:0:19289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19289:1875730538548224:0@lo:104: 00010000:00010000:3.0:1788836493.161054:0:19289:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd07efb3800/0xcb5b7bc40b90ab0f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836493.161071:0:18843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836493.161077:0:18843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd040031400/0xcb5b7bc40b90aac9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90aad0 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836493.161096:0:18843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040031400 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:3.0:1788836493.161100:0:18843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd040031400/0xcb5b7bc40b90aac9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b90aad0 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836493.161110:0:18843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd040031400/0xcb5b7bc40b90aac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b90aad0 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836493.161296:0:18843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd040031400/0xcb5b7bc40b90aac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b90aad0 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836493.161303:0:18843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788836493.161422:0:18843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd040031400/0xcb5b7bc40b90aac9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90aad0 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836493.161429:0:18843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836493.161452:0:18843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd040031400/0xcb5b7bc40b90aac9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90aad0 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836493.161459:0:18843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd040031400/0xcb5b7bc40b90aac9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90aad0 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836493.161474:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836493.161476:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836493.161477:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836493.161486:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788836493.161499:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc96480a-9861-42d8-abb0-6f65502ae376:3304:1875730538548352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836493.161543:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836493.161595:0:18840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538548352 00000100:00100000:3.0:1788836493.161601:0:18840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538548352 00010000:00010000:3.0:1788836493.161632:0:18840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd07efb2600/0xcb5b7bc40b90aad0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90aac9 expref: 12 pid: 18847 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836493.161734:0:18840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836493.161743:0:18840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc96480a-9861-42d8-abb0-6f65502ae376+12:3304:x1875730538548352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836493.161753:0:18840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836493.161758:0:18840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd07efb2600/0xcb5b7bc40b90aad0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90aac9 expref: 12 pid: 18847 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836493.161768:0:18840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd07efb2600/0xcb5b7bc40b90aad0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b90aac9 expref: 12 pid: 18847 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836493.161781:0:18840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd07efb2600/0xcb5b7bc40b90aad0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b90aac9 expref: 12 pid: 18847 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836493.161796:0:18840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd07efb3800/0xcb5b7bc40b90ab0f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836493.161804:0:18840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd07efb3800/0xcb5b7bc40b90ab0f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836493.161818:0:18840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd07efb3800/0xcb5b7bc40b90ab0f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836493.161825:0:18840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd07efb3800/0xcb5b7bc40b90ab0f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836493.161830:0:18840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd07efb3800/0xcb5b7bc40b90ab0f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836493.161836:0:18840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd07efb3800/0xcb5b7bc40b90ab0f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836493.161850:0:18840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07efb3800 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836493.161854:0:18840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd07efb3800/0xcb5b7bc40b90ab0f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836493.161863:0:18840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd07efb3800/0xcb5b7bc40b90ab0f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836493.161872:0:18840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd07efb3800/0xcb5b7bc40b90ab0f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836493.161881:0:18840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836493.161917:0:18840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc96480a-9861-42d8-abb0-6f65502ae376+11:3304:x1875730538548352:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836493.161924:0:18840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836493.161954:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc96480a-9861-42d8-abb0-6f65502ae376:3304:1875730538548352:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836493.161971:0:19289:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd07efb3800/0xcb5b7bc40b90ab0f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836493.161979:0:19289:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd07efb3800/0xcb5b7bc40b90ab0f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836493.161985:0:19289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd07efb3800/0xcb5b7bc40b90ab0f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836493.201192:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836494.225504:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788836494.293551:0:18853:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788836494.293562:0:18853:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bcf46073800 from 10 10000000:01000000:3.0:1788836494.293568:0:18853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788836494.293619:0:18853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040031600/0xcb5b7bc40b90ab16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836494.293652:0:18853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd040031600/0xcb5b7bc40b90ab16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836494.293665:0:18853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd040031600/0xcb5b7bc40b90ab16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836494.293694:0:18853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538548480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788836494.293767:0:18853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836494.293820:0:18853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788836494.293937:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538548480 00000100:00100000:0.0:1788836494.293944:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538548480 00000100:00100000:0.0:1788836494.293997:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788836494.294006:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4502d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+11:18853:x1875730538548480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836494.294019:0:18850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836494.294031:0:18850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd08217ca00/0xcb5b7bc40b90ab1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90ab16 expref: -99 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836494.294053:0:18850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd08217ca00/0xcb5b7bc40b90ab1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90ab16 expref: 12 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836494.294062:0:18850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd08217ca00/0xcb5b7bc40b90ab1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90ab16 expref: 12 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836494.294071:0:18850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217ca00, rc 0) 00000100:00100000:0.0:1788836494.294119:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4502d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+12:18853:x1875730538548480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836494.294126:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788836494.294214:0:18853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538548480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836494.294227:0:18853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd040031600/0xcb5b7bc40b90ab16 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90ab1d expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836494.294236:0:18853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd040031600/0xcb5b7bc40b90ab16 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90ab1d expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836494.294286:0:18853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538548608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836494.294310:0:18853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836494.294333:0:18853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788836494.294391:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538548608 00000100:00100000:2.0:1788836494.294395:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538548608 00000100:00100000:2.0:1788836494.294422:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788836494.294430:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4502e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+12:18853:x1875730538548608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836494.294682:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4502e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+12:18853:x1875730538548608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836494.294689:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788836494.294774:0:18853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538548608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836494.294801:0:18853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538548736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788836494.294838:0:18853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836494.294866:0:18853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788836494.295386:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538548736 00000100:00100000:2.0:1788836494.295391:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538548736 00000100:00100000:2.0:1788836494.295426:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788836494.295433:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4502c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+12:18853:x1875730538548736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836494.295587:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4502c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+12:18853:x1875730538548736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836494.295595:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788836494.297501:0:18853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538548736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788836494.298419:0:19343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788836494.308504:0:18853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788836494.308556:0:18853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788836494.308567:0:18853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040031600/0xcb5b7bc40b90ab16 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90ab1d expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836494.308579:0:18853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd040031600/0xcb5b7bc40b90ab16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90ab1d expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836494.674610:0:3301:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836484/real 1788836484] req@ffff9bd07a3ded80 x1875730538545408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836494 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836494.674653:0:3301:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd07a3ded80 x1875730538545408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836494 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836494.674665:0:3301:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836484/real 1788836484] req@ffff9bd07ad03100 x1875730538545280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836494 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836494.674676:0:3301:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd07ad03100 x1875730538545280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836494 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788836494.674696:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd07af71000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788836494.675478:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836494.675484:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788836494.675504:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836494.675507:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788836494.675510:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd07af71000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788836494.675524:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 537 00000100:00080000:3.0:1788836494.675529:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788836494.675536:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bd07af71000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788836494.675577:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd07ad02300 x1875730538548864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788836494.675662:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788836494.675678:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875730538548992:0@lo:400:kworker.0 00000100:00100000:3.0:1788836494.675760:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836494.675830:0:18855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538548992 00000100:00100000:3.0:1788836494.675838:0:18855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538548992 00000100:00100000:3.0:1788836494.675880:0:18855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788836494.675889:0:18855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875730538548992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836494.675949:0:18855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875730538548992:12345-0@lo:400:kworker.0 Request processed in 60us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836494.675957:0:18855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788836494.675992:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bd07ad00700 x1875730538548992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836494.676004:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875730538548992:0@lo:400:kworker.0 00000100:00080000:1.0:1788836494.677088:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788836494.677095:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538545408:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788836494.677097:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836494.677101:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788836494.677104:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd07b264800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788836494.677119:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836494.677119:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00080000:2.0:1788836494.677122:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00100000:1.0:1788836494.677123:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538545280:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788836494.677125:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd07b264800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1788836494.677296:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538548864:0@lo:8:kworker.0 00000400:00000100:1.0:1788836494.677338:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875730538548864 offset 0 length 520: 4 00000100:00080000:2.0:1788836494.679949:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 537 00000100:00080000:2.0:1788836494.679959:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788836494.679968:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bd07b264800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788836494.681920:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd07a359880 x1875730538549120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788836494.682247:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538549120:0@lo:8:kworker.0 00000400:00000100:1.0:1788836494.682306:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875730538549120 offset 0 length 520: 4 00010000:00010000:0.0:1788836495.252699:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836496.272570:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788836496.849284:0:18889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788836497.298654:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788836497.969891:0:19538:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788836497.969895:0:19538:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788836497.970011:0:19538:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bd047f4c000 00000020:01000004:0.0:1788836497.970027:0:19538:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788836497.970038:0:19538:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788836497.970052:0:19538:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9bd07d378000) 00000020:00000080:0.0:1788836497.970067:0:19538:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788836497.985916:0:19538:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788836497.986178:0:19538:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788836497.987036:0:19538:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788836497.987277:0:19538:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788836497.987566:0:19538:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:2.0:1788836497.987895:0:19538:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 499: rc = 0 00100000:10000000:2.0:1788836497.988024:0:19538:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 499: rc = 0 00100000:10000000:2.0:1788836497.988161:0:19538:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 499: rc = 0 00100000:10000000:2.0:1788836497.988720:0:19538:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 163: rc = 0 00100000:10000000:2.0:1788836497.988971:0:19538:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 163: rc = 0 00100000:10000000:2.0:1788836497.989208:0:19538:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 163: rc = 0 00100000:10000000:2.0:1788836497.989505:0:19538:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 163: rc = 0 00100000:10000000:2.0:1788836497.989738:0:19538:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 163: rc = 0 00100000:10000000:2.0:1788836497.989971:0:19538:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 163: rc = 0 00000020:00000080:3.0:1788836497.990726:0:19538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788836497.990738:0:19538:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788836497.990749:0:19538:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcb5b7bc40b90ab2b 00000020:01000004:3.0:1788836497.990757:0:19538:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788836497.990778:0:19538:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.152@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788836497.990781:0:19538:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788836497.990787:0:19538:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788836497.990791:0:19538:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788836497.990803:0:19538:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9bd07acd0000) 00000020:00000080:3.0:1788836497.990821:0:19538:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788836497.991944:0:19538:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788836497.992117:0:19538:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788836497.992123:0:19538:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788836497.996291:0:19538:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788836497.996304:0:19538:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788836497.996685:0:19538:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788836497.996691:0:19538:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788836497.997849:0:19538:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788836497.998033:0:19538:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788836497.998038:0:19538:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788836498.000705:0:19538:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788836498.000714:0:19538:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788836498.018206:0:19538:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788836498.018664:0:19538:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788836498.018671:0:19538:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788836498.020043:0:19538:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788836498.020054:0:19538:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788836498.021057:0:19538:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788836498.021066:0:19538:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788836498.022925:0:19538:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788836498.023321:0:19538:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788836498.023328:0:19538:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788836498.024128:0:19538:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788836498.024135:0:19538:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788836498.052153:0:19538:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788836498.052511:0:19538:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788836498.052517:0:19538:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788836498.056386:0:19538:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788836498.056401:0:19538:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788836498.058908:0:19538:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788836498.058935:0:19538:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788836498.058941:0:19538:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788836498.071318:0:19538:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788836498.071465:0:19538:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.152@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788836498.071470:0:19538:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788836498.071472:0:19538:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788836498.071473:0:19538:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788836498.071474:0:19538:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788836498.071475:0:19538:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788836498.071476:0:19538:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788836498.071478:0:19538:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788836498.071480:0:19538:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788836498.071481:0:19538:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788836498.071485:0:19538:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788836498.071487:0:19538:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788836498.071489:0:19538:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788836498.071490:0:19538:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788836498.071491:0:19538:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788836498.071492:0:19538:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788836498.071493:0:19538:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788836498.071494:0:19538:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788836498.071495:0:19538:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788836498.071496:0:19538:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788836498.071522:0:19538:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788836498.071548:0:19538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a358e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538549248:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788836498.071616:0:19538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836498.071720:0:19538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046707480 going to sleep for 11 seconds 00000100:00100000:2.0:1788836498.071774:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538549248 00000100:00100000:2.0:1788836498.071781:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538549248 00000100:00100000:2.0:1788836498.071875:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788836498.071885:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4502c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+12:19538:x1875730538549248:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788836498.071913:0:18847:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788836498.071916:0:18847:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788836498.071920:0:18847:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788836498.082045:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4502c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+12:19538:x1875730538549248:12345-0@lo:253:mount.lustre.0 Request processed in 10154us (10421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836498.082058:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788836498.082179:0:19538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a358e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538549248:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788836498.082299:0:19538:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788836498.082303:0:19538:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788836498.082304:0:19538:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788836498.082306:0:19538:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788836498.082307:0:19538:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788836498.082308:0:19538:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788836498.082309:0:19538:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788836498.082311:0:19538:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788836498.082312:0:19538:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788836498.082313:0:19538:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788836498.082339:0:19538:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bd047f4c000 from lustre-OST0000 10000000:01000000:0.0:1788836498.082426:0:19538:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788836498.082429:0:19538:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788836498.082436:0:19538:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bd07d37cd28 local copy 00010000:00010000:0.0:1788836498.082446:0:19538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040031a00/0xcb5b7bc40b90aa21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90aa28 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836498.082939:0:19538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a358e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538549376:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836498.082974:0:19538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836498.083048:0:19538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047ae8300 going to sleep for 11 seconds 00000100:00100000:2.0:1788836498.083081:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538549376 00000100:00100000:2.0:1788836498.083149:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538549376 00000100:00100000:2.0:1788836498.083360:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788836498.083370:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4502d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+12:19538:x1875730538549376:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836498.083590:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4502d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+12:19538:x1875730538549376:12345-0@lo:501:mount.lustre.0 Request processed in 219us (612us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788836498.083598:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788836498.083757:0:19538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a358e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538549376:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788836498.083774:0:19538:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788836498.083981:0:19538:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788836498.083990:0:19538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040031a00/0xcb5b7bc40b90aa21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90aa28 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836498.083999:0:19538:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd040031a00/0xcb5b7bc40b90aa21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90aa28 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836498.084021:0:19538:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bd047f4c000 10000000:01000000:3.0:1788836498.084029:0:19538:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788836498.084034:0:19538:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9bd07d37cd28 10000000:01000000:3.0:1788836498.084036:0:19538:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788836498.084040:0:19538:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9bd07d37cd28 from 1 10000000:01000000:3.0:1788836498.084043:0:19538:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788836498.084069:0:19538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040030000/0xcb5b7bc40b90ab39 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836498.084076:0:19538:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd040030000/0xcb5b7bc40b90ab39 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836498.084314:0:19538:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd040030000/0xcb5b7bc40b90ab39 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836498.084515:0:19538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538549504:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788836498.084557:0:19538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836498.084626:0:19538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0517dfb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788836498.084670:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538549504 00000100:00100000:2.0:1788836498.084676:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538549504 00000100:00100000:2.0:1788836498.084746:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788836498.084754:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4502fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+12:19538:x1875730538549504:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788836498.084766:0:18847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836498.084778:0:18847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd07efb3600/0xcb5b7bc40b90ab40 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90ab39 expref: -99 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836498.084799:0:18847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd07efb3600/0xcb5b7bc40b90ab40 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90ab39 expref: 13 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836498.084808:0:18847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd07efb3600/0xcb5b7bc40b90ab40 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90ab39 expref: 13 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836498.084818:0:18847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07efb3600, rc 0) 00000100:00100000:2.0:1788836498.084940:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4502fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+13:19538:x1875730538549504:12345-0@lo:101:mount.lustre.0 Request processed in 186us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836498.084946:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788836498.085016:0:19538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538549504:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788836498.085029:0:19538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd040030000/0xcb5b7bc40b90ab39 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90ab40 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836498.085038:0:19538:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd040030000/0xcb5b7bc40b90ab39 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90ab40 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836498.085055:0:19538:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788836498.085072:0:19538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040030000/0xcb5b7bc40b90ab39 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90ab40 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836498.085080:0:19538:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd040030000/0xcb5b7bc40b90ab39 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90ab40 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836498.085208:0:19538:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788836498.085211:0:19538:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788836498.085216:0:19538:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788836498.085218:0:19538:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788836498.085233:0:19538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040031400/0xcb5b7bc40b90ab47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836498.085413:0:19538:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd040031400/0xcb5b7bc40b90ab47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836498.085423:0:19538:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd040031400/0xcb5b7bc40b90ab47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836498.085439:0:19538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538549632:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788836498.085468:0:19538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836498.085507:0:19538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0517dfb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788836498.085559:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538549632 00000100:00100000:0.0:1788836498.085564:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538549632 00000100:00100000:0.0:1788836498.085596:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788836498.085604:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4502ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+13:19538:x1875730538549632:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788836498.085613:0:18849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836498.085622:0:18849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd08217cc00/0xcb5b7bc40b90ab4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90ab47 expref: -99 pid: 18849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836498.085650:0:18849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd08217cc00/0xcb5b7bc40b90ab4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90ab47 expref: 14 pid: 18849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836498.085658:0:18849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd08217cc00/0xcb5b7bc40b90ab4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90ab47 expref: 14 pid: 18849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836498.085666:0:18849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217cc00, rc 0) 00000100:00100000:0.0:1788836498.085704:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4502ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+14:19538:x1875730538549632:12345-0@lo:101:mount.lustre.0 Request processed in 101us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836498.085710:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788836498.085986:0:19538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538549632:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788836498.085997:0:19538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd040031400/0xcb5b7bc40b90ab47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90ab4e expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836498.086006:0:19538:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd040031400/0xcb5b7bc40b90ab47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90ab4e expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788836498.086994:0:19538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:3.0:1788836498.088664:0:19538:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788836498.089016:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788836498.089059:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1788836498.089159:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1788836498.089446:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1788836498.089488:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1788836498.089519:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1788836498.089564:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1788836498.089598:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1788836498.089632:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1788836498.089695:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1788836498.089730:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1788836498.089774:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1788836498.089830:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1788836498.089838:0:19538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:3.0:1788836498.089972:0:19538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538549760:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788836498.090030:0:19538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836498.090117:0:19538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0517df3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836498.090304:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538549760 00000100:00100000:0.0:1788836498.090312:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538549760 00000100:00100000:0.0:1788836498.090514:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788836498.090524:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd048098c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+14:19538:x1875730538549760:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836498.090856:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd048098c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+14:19538:x1875730538549760:12345-0@lo:501:mount.lustre.0 Request processed in 333us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836498.090873:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788836498.090944:0:19538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538549760:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788836498.090978:0:19538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538549888:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788836498.091016:0:19538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836498.091185:0:19538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0517df3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836498.091305:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538549888 00000100:00100000:1.0:1788836498.091311:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538549888 00000100:00100000:1.0:1788836498.091369:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788836498.091376:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd048098850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+14:19538:x1875730538549888:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788836498.091648:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd048098850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+14:19538:x1875730538549888:12345-0@lo:503:mount.lustre.0 Request processed in 271us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836498.091656:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788836498.091748:0:19538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538549888:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788836498.092659:0:19538:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788836498.092725:0:19538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538550016:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836498.092776:0:19538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836498.092846:0:19538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046709f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788836498.092987:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538550016 00000100:00100000:2.0:1788836498.092995:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538550016 00000100:00100000:1.0:1788836498.093073:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788836498.093083:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04809a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+14:19538:x1875730538550016:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836498.094053:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04809a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+14:19538:x1875730538550016:12345-0@lo:502:mount.lustre.0 Request processed in 969us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836498.094062:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788836498.094695:0:19538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538550016:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788836498.094973:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1788836498.095035:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1788836498.095070:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1788836498.095420:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1788836498.095471:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1788836498.095504:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1788836498.095548:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1788836498.095581:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1788836498.095611:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:0.0:1788836498.095667:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:0.0:1788836498.095699:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:0.0:1788836498.095742:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:0.0:1788836498.095783:0:19538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a359c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538550144:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836498.095839:0:19538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836498.095886:0:19538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047ae8240 going to sleep for 11 seconds 00000100:00100000:2.0:1788836498.095981:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538550144 00000100:00100000:2.0:1788836498.095990:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538550144 00000100:00100000:2.0:1788836498.096035:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788836498.096045:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04809b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+14:19538:x1875730538550144:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788836498.096662:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04809b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+14:19538:x1875730538550144:12345-0@lo:502:mount.lustre.0 Request processed in 616us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836498.096670:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788836498.097016:0:19538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a359c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538550144:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788836498.108229:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1788836498.108286:0:19538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1788836498.109615:0:19552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788836498.109624:0:19552:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788836498.109631:0:19552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836498.109633:0:19552:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788836498.109640:0:19552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788836498.109653:0:19552:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9bd07b2319b8) 00000020:00000080:1.0:1788836498.109673:0:19552:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788836498.109679:0:19552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788836498.109755:0:19552:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd047f4c000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788836498.109762:0:19552:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788836498.109770:0:19552:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcb5b7bc40b90ab5c 00010000:00010000:1.0:1788836498.117138:0:19552:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1788836498.118825:0:19552:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934593 00080000:10000000:1.0:1788836498.122605:0:19552:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:1.0:1788836498.124655:0:19552:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788836498.124667:0:19552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836498.124681:0:19552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836498.124683:0:19552:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788836498.124687:0:19552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788836498.124690:0:19552:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1788836498.124692:0:19552:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788836498.124693:0:19552:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788836498.124695:0:19552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788836498.124698:0:19552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836498.124699:0:19552:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788836498.124702:0:19552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836498.124705:0:19552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836498.124706:0:19552:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788836498.124709:0:19552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788836498.124710:0:19552:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788836498.124712:0:19552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836498.124715:0:19552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836498.124716:0:19552:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788836498.124718:0:19552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836498.124720:0:19552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836498.124722:0:19552:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788836498.124725:0:19552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788836498.124781:0:19552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836498.124785:0:19552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836498.124786:0:19552:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788836498.124789:0:19552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:3.0:1788836498.124959:0:19538:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788836498.124991:0:19538:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788836498.125014:0:19538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040031400/0xcb5b7bc40b90ab47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90ab4e expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836498.125026:0:19538:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd040031400/0xcb5b7bc40b90ab47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90ab4e expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836498.125034:0:19538:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd047f4c000 from 1 10000000:01000000:3.0:1788836498.125037:0:19538:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788836498.125068:0:19538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040031800/0xcb5b7bc40b90ab63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836498.125077:0:19538:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd040031800/0xcb5b7bc40b90ab63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836498.125098:0:19538:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd040031800/0xcb5b7bc40b90ab63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836498.125121:0:19538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad02d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538550272:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788836498.125189:0:19538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836498.125225:0:19538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046709000 going to sleep for 11 seconds 00000100:00100000:1.0:1788836498.125484:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538550272 00000100:00100000:1.0:1788836498.125491:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538550272 00000100:00100000:1.0:1788836498.125526:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788836498.125534:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04809ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+14:19538:x1875730538550272:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836498.125546:0:18850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836498.125557:0:18850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd07978aa00/0xcb5b7bc40b90ab6a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90ab63 expref: -99 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836498.125579:0:18850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd07978aa00/0xcb5b7bc40b90ab6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90ab63 expref: 15 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836498.125598:0:18850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd07978aa00/0xcb5b7bc40b90ab6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90ab63 expref: 15 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836498.125607:0:18850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978aa00, rc 0) 00000100:00100000:1.0:1788836498.125648:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04809ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+15:19538:x1875730538550272:12345-0@lo:101:mount.lustre.0 Request processed in 114us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836498.125654:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788836498.125795:0:19538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad02d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538550272:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788836498.125808:0:19538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd040031800/0xcb5b7bc40b90ab63 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90ab6a expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836498.125819:0:19538:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd040031800/0xcb5b7bc40b90ab63 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90ab6a expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788836498.126565:0:19538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:3.0:1788836498.126828:0:19538:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788836498.127047:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788836498.127163:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1788836498.127288:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1788836498.127338:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788836498.130078:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788836498.130442:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788836498.130491:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1788836498.130524:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1788836498.130624:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788836498.130633:0:19538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:2.0:1788836498.130735:0:19538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3ddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538550400:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836498.130793:0:19538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836498.131571:0:19538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd048669e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788836498.134232:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538550400 00000100:00100000:0.0:1788836498.134253:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538550400 00000100:00100000:0.0:1788836498.134365:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788836498.134376:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04809bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+15:19538:x1875730538550400:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836498.134646:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04809bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+15:19538:x1875730538550400:12345-0@lo:501:mount.lustre.0 Request processed in 272us (3852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836498.134654:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788836498.138455:0:19538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3ddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538550400:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788836498.138518:0:19538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad02d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538550528:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788836498.138589:0:19538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836498.138628:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538550528 00000100:00100000:3.0:1788836498.138634:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538550528 00000100:00100000:3.0:1788836498.138675:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788836498.138684:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd048099050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+15:19538:x1875730538550528:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788836498.138854:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd048099050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+15:19538:x1875730538550528:12345-0@lo:503:mount.lustre.0 Request processed in 171us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836498.138862:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788836498.138915:0:19538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0467090c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836498.138928:0:19538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad02d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538550528:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788836498.139706:0:19538:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788836498.139785:0:19538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad02d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538550656:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836498.139829:0:19538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836498.139860:0:19538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0467090c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836498.139934:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538550656 00000100:00100000:0.0:1788836498.139939:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538550656 00000100:00100000:0.0:1788836498.139977:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788836498.139985:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd048098450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+15:19538:x1875730538550656:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836498.140582:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd048098450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+15:19538:x1875730538550656:12345-0@lo:502:mount.lustre.0 Request processed in 595us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836498.140590:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788836498.141008:0:19538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad02d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538550656:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788836498.141597:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788836498.141653:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788836498.141704:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788836498.141745:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788836498.141782:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788836498.141835:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788836498.141887:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788836498.141923:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:3.0:1788836498.141962:0:19538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad02d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538550784:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836498.142018:0:19538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836498.142059:0:19538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0467090c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836498.142439:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538550784 00000100:00100000:0.0:1788836498.142447:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538550784 00000100:00100000:0.0:1788836498.142525:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788836498.142535:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd048098050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+15:19538:x1875730538550784:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836498.142723:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd048098050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+15:19538:x1875730538550784:12345-0@lo:502:mount.lustre.0 Request processed in 189us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836498.142731:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788836498.142887:0:19538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad02d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538550784:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788836498.142992:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788836498.143003:0:19538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788836498.144600:0:19556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836498.144610:0:19556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836498.144612:0:19556:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788836498.144619:0:19556:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd047f4c000 00000020:00000080:3.0:1788836498.144622:0:19556:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788836498.144628:0:19556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836498.144630:0:19556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836498.144631:0:19556:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788836498.144633:0:19556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836498.144635:0:19556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836498.144636:0:19556:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788836498.144639:0:19556:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd047f4c000 00000020:00000080:3.0:1788836498.144641:0:19556:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788836498.144728:0:19556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836498.144733:0:19556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836498.144734:0:19556:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788836498.144737:0:19556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836498.144739:0:19556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836498.144740:0:19556:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788836498.144744:0:19556:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd047f4c000 00000020:00000080:3.0:1788836498.144745:0:19556:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788836498.145430:0:19556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836498.145435:0:19556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836498.145437:0:19556:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788836498.145450:0:19556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:1.0:1788836498.148610:0:19538:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788836498.148654:0:19538:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788836498.150209:0:19538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040031800/0xcb5b7bc40b90ab63 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90ab6a expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836498.150227:0:19538:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd040031800/0xcb5b7bc40b90ab63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90ab6a expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836498.150451:0:19538:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788836498.150455:0:19538:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bd047f4c000 10000000:01000000:1.0:1788836498.150458:0:19538:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bd047f4c000 10000000:01000000:1.0:1788836498.150463:0:19538:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788836498.150468:0:19538:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd047f4c000 from 1 10000000:01000000:1.0:1788836498.150471:0:19538:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788836498.150508:0:19538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd07978b000/0xcb5b7bc40b90ab71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836498.150518:0:19538:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd07978b000/0xcb5b7bc40b90ab71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836498.150530:0:19538:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd07978b000/0xcb5b7bc40b90ab71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836498.150564:0:19538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07accad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538550912:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788836498.150629:0:19538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836498.150673:0:19538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0412edcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836498.152280:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538550912 00000100:00100000:1.0:1788836498.152290:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538550912 00000100:00100000:1.0:1788836498.152361:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788836498.152372:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04809a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+15:19538:x1875730538550912:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836498.152386:0:18847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836498.152404:0:18847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd07978a800/0xcb5b7bc40b90ab78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90ab71 expref: -99 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836498.152431:0:18847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd07978a800/0xcb5b7bc40b90ab78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90ab71 expref: 16 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836498.152442:0:18847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd07978a800/0xcb5b7bc40b90ab78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90ab71 expref: 16 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836498.152451:0:18847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978a800, rc 0) 00000100:00100000:1.0:1788836498.152511:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04809a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+16:19538:x1875730538550912:12345-0@lo:101:mount.lustre.0 Request processed in 142us (1882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836498.152518:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788836498.152572:0:19538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07accad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538550912:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836498.152589:0:19538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd07978b000/0xcb5b7bc40b90ab71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90ab78 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836498.152599:0:19538:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd07978b000/0xcb5b7bc40b90ab71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90ab78 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788836498.153202:0:19538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:1.0:1788836498.153613:0:19538:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788836498.153852:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788836498.153898:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1788836498.153932:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1788836498.153980:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1788836498.154017:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1788836498.154062:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1788836498.154096:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1788836498.154132:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1788836498.154199:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1788836498.154240:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1788836498.154273:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1788836498.154319:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1788836498.154393:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1788836498.154428:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1788836498.154479:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1788836498.154513:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1788836498.154549:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1788836498.154600:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1788836498.154639:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1788836498.154677:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1788836498.154723:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1788836498.154755:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1788836498.154787:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1788836498.154836:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1788836498.154873:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:1.0:1788836498.154902:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:1.0:1788836498.154941:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:1.0:1788836498.154973:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:1.0:1788836498.155007:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:1.0:1788836498.155068:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:1.0:1788836498.155102:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:1.0:1788836498.155136:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:1.0:1788836498.155168:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:1.0:1788836498.155214:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:1.0:1788836498.155249:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:1.0:1788836498.155299:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:1.0:1788836498.164293:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:1.0:1788836498.164564:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:1.0:1788836498.164640:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:1.0:1788836498.164692:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:1.0:1788836498.164811:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:1.0:1788836498.164821:0:19538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:1.0:1788836498.164926:0:19538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07accad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538551040:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836498.164996:0:19538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836498.165040:0:19538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0412edcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836498.165498:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538551040 00000100:00100000:1.0:1788836498.165506:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538551040 00000100:00100000:1.0:1788836498.165554:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788836498.165563:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd048099850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+16:19538:x1875730538551040:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836498.165852:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd048099850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+16:19538:x1875730538551040:12345-0@lo:501:mount.lustre.0 Request processed in 232us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836498.165860:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788836498.165915:0:19538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07accad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538551040:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836498.165960:0:19538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07accad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538551168:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788836498.165999:0:19538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836498.166022:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538551168 00000100:00100000:1.0:1788836498.166026:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538551168 00000100:00100000:1.0:1788836498.166151:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788836498.166159:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04809b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+16:19538:x1875730538551168:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788836498.166292:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04809b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+16:19538:x1875730538551168:12345-0@lo:503:mount.lustre.0 Request processed in 134us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836498.166298:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788836498.166369:0:19538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0412edcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836498.166738:0:19538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07accad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538551168:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788836498.167599:0:19538:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788836498.167681:0:19538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07accad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538551296:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836498.167740:0:19538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836498.167903:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538551296 00000100:00100000:1.0:1788836498.167910:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538551296 00000100:00100000:1.0:1788836498.167947:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788836498.167955:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd048099c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+16:19538:x1875730538551296:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836498.168164:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd048099c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+16:19538:x1875730538551296:12345-0@lo:502:mount.lustre.0 Request processed in 207us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836498.168172:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788836498.168223:0:19538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0508e0000 going to sleep for 11 seconds 00000100:00100000:1.0:1788836498.168241:0:19538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07accad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538551296:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788836498.168487:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788836498.168536:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1788836498.168572:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1788836498.168620:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1788836498.168657:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1788836498.170315:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1788836498.170388:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1788836498.170440:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1788836498.170515:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788836498.170583:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1788836498.170655:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1788836498.171160:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1788836498.171216:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1788836498.171252:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1788836498.171299:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1788836498.171380:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1788836498.171432:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1788836498.171478:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1788836498.171514:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1788836498.171546:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1788836498.171586:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1788836498.171617:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1788836498.171647:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1788836498.171735:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1788836498.171772:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:1.0:1788836498.171805:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:1.0:1788836498.171851:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:1.0:1788836498.171884:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:1.0:1788836498.171918:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:1.0:1788836498.171964:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:1.0:1788836498.171999:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:1.0:1788836498.172031:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:1.0:1788836498.172081:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:1.0:1788836498.172128:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:1.0:1788836498.172162:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:1.0:1788836498.172208:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:1.0:1788836498.172242:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:1.0:1788836498.172273:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:1.0:1788836498.172324:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:1.0:1788836498.172416:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:1.0:1788836498.172464:0:19538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07accad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538551424:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836498.172541:0:19538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836498.172593:0:19538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0508e0000 going to sleep for 11 seconds 00000100:00100000:2.0:1788836498.177441:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538551424 00000100:00100000:2.0:1788836498.177456:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538551424 00000100:00100000:2.0:1788836498.177521:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788836498.177532:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd048099450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+16:19538:x1875730538551424:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788836498.177809:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd048099450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+16:19538:x1875730538551424:12345-0@lo:502:mount.lustre.0 Request processed in 278us (5267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836498.177817:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788836498.177933:0:19538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07accad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538551424:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788836498.178041:0:19538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:1.0:1788836498.178057:0:19538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788836498.181012:0:19561:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788836498.181028:0:19561:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9bd044d03370) 00000020:00000080:2.0:1788836498.181050:0:19561:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788836498.181145:0:19561:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd047f4c000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788836498.181149:0:19561:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd047f4c000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788836498.181152:0:19561:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd047f4c000 3 00010000:00080000:2.0:1788836498.181197:0:19561:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd07a3ac800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.152@tcp at head 00010000:00010000:1.0:1788836498.198601:0:19561:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1788836498.198787:0:19561:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788836498.198827:0:19561:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788836498.198838:0:19561:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcb5b7bc40b90ab86 00000100:00080000:1.0:1788836498.198848:0:19561:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788836498.198854:0:19561:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bd07a3ac800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788836498.199107:0:19561:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd07accad80 x1875730538551552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788836498.199138:0:19561:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788836498.199626:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836498.199631:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788836498.199634:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836498.199637:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788836498.199727:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07accad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1875730538551552:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788836498.199795:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836498.200050:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538551552 00000100:00100000:1.0:1788836498.200057:0:18856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538551552 00000100:00100000:1.0:1788836498.200094:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788836498.200101:0:18856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3301:x1875730538551552:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788836498.200133:0:18856:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:1.0:1788836498.200167:0:18856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcb5b7bc40b90ab8d 00000004:00100000:1.0:1788836498.200182:0:18856:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788836498.200220:0:18856:0:(import.c:65:import_set_state_nolock()) ffff9bcf45ede000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788836498.200272:0:18856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875730538551552:12345-0@lo:38:llog_process_th.0 Request processed in 169us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836498.200279:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788836498.200396:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bd07accad80 x1875730538551552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788836508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836498.200407:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788836498.200413:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1788836498.200420:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788836498.200424:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788836498.200426:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd07a3ac800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788836498.200432:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07accad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1875730538551552:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788836498.200652:0:19561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:1.0:1788836498.200761:0:19538:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788836498.200789:0:19538:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788836498.200806:0:19538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd07978b000/0xcb5b7bc40b90ab71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90ab78 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836498.200816:0:19538:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd07978b000/0xcb5b7bc40b90ab71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90ab78 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788836498.200861:0:19538:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788836498.200864:0:19538:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788836498.200865:0:19538:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788836498.200867:0:19538:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788836498.200868:0:19538:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788836498.200869:0:19538:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788836498.200871:0:19538:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788836498.200873:0:19538:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788836498.200874:0:19538:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788836498.200878:0:19538:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788836498.200880:0:19538:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788836498.200882:0:19538:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788836498.200883:0:19538:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788836498.200884:0:19538:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788836498.200885:0:19538:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788836498.200886:0:19538:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788836498.200887:0:19538:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788836498.200888:0:19538:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788836498.200890:0:19538:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788836498.200905:0:19538:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788836498.200919:0:19538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538551808:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788836498.201284:0:19538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836498.201326:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538551808 00000100:00100000:1.0:1788836498.201340:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538551808 00000100:00100000:1.0:1788836498.201398:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788836498.201405:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04809a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+16:19538:x1875730538551808:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788836498.201427:0:18850:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788836498.201439:0:18850:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788836498.201761:0:19538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0508e0180 going to sleep for 11 seconds 00000100:00100000:0.0:1788836498.204583:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788836498.204605:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07accb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538551680:0@lo:400:kworker.0 00000100:00100000:0.0:1788836498.204670:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836498.204778:0:18855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538551680 00000100:00100000:1.0:1788836498.204787:0:18855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538551680 00000100:00100000:1.0:1788836498.204829:0:18855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788836498.204839:0:18855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a35bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538551680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836498.204893:0:18855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a35bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538551680:12345-0@lo:400:kworker.0 Request processed in 55us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836498.204901:0:18855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788836498.205788:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bd07accb800 x1875730538551680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836498.205803:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07accb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538551680:0@lo:400:kworker.0 20000000:01000000:1.0:1788836498.233759:0:18850:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788836498.233780:0:18850:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788836498.234071:0:18871:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788836498.234076:0:18871:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788836498.234107:0:18871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90ab94 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836498.234124:0:18871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd08217d200/0xcb5b7bc40b90ab01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90aafa expref: 16 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836498.234131:0:18871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90ab94 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836498.234168:0:18871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd08217d200/0xcb5b7bc40b90ab01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b90aafa expref: 16 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836498.234182:0:18871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd08217d200/0xcb5b7bc40b90ab01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b90aafa expref: 16 pid: 18850 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836498.234195:0:18871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad01f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18871:1875730538551936:0@lo:104: 00000100:00100000:3.0:1788836498.234269:0:18871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836498.234437:0:18871:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0467090c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836498.234536:0:18839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538551936 00000100:00100000:1.0:1788836498.234544:0:18839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538551936 00000100:00100000:1.0:1788836498.234584:0:18839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788836498.234593:0:18839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc96480a-9861-42d8-abb0-6f65502ae376+3:18871:x1875730538551936:12345-0@lo:104: 00010000:00010000:1.0:1788836498.234605:0:18839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd07efb3000/0xcb5b7bc40b90aafa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90ab01 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836498.234658:0:18839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788836498.234665:0:18839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc96480a-9861-42d8-abb0-6f65502ae376+3:18871:x1875730538551936:12345-0@lo:104: Request processed in 73us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836498.234671:0:18839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788836498.234718:0:18871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad01f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18871:1875730538551936:0@lo:104: 00010000:00010000:1.0:1788836498.234738:0:18871:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90ab94 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836498.234754:0:18843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836498.234759:0:18843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd07efb3000/0xcb5b7bc40b90aafa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90ab01 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836498.234767:0:18843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07efb3000 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:1.0:1788836498.234770:0:18843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd07efb3000/0xcb5b7bc40b90aafa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b90ab01 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836498.234779:0:18843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd07efb3000/0xcb5b7bc40b90aafa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b90ab01 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836498.234786:0:18843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd07efb3000/0xcb5b7bc40b90aafa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b90ab01 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836498.234791:0:18843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788836498.234816:0:18843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd07efb3000/0xcb5b7bc40b90aafa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90ab01 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836498.234822:0:18843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788836498.234839:0:18843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd07efb3000/0xcb5b7bc40b90aafa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90ab01 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836498.234846:0:18843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd07efb3000/0xcb5b7bc40b90aafa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90ab01 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836498.234860:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836498.234862:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836498.234871:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836498.234895:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc96480a-9861-42d8-abb0-6f65502ae376:3304:1875730538552064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788836498.234924:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836498.234963:0:18842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538552064 00000100:00100000:1.0:1788836498.234967:0:18842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538552064 00010000:00010000:1.0:1788836498.234981:0:18842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd08217d200/0xcb5b7bc40b90ab01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90aafa expref: 17 pid: 18850 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836498.235001:0:18842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788836498.235007:0:18842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07accaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc96480a-9861-42d8-abb0-6f65502ae376+17:3304:x1875730538552064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788836498.235030:0:18842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836498.235036:0:18842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd08217d200/0xcb5b7bc40b90ab01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90aafa expref: 17 pid: 18850 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836498.235045:0:18842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd08217d200/0xcb5b7bc40b90ab01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b90aafa expref: 17 pid: 18850 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836498.235058:0:18842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd08217d200/0xcb5b7bc40b90ab01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b90aafa expref: 17 pid: 18850 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836498.235068:0:18842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90ab94 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836498.235074:0:18842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90ab94 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788836498.235224:0:18842:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001147917s 00010000:00010000:1.0:1788836498.235229:0:18842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90ab94 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836498.235237:0:18842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90ab94 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836498.235250:0:18842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90ab94 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836498.235256:0:18842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90ab94 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836498.235261:0:18842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040030400 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836498.235265:0:18842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90ab94 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836498.235272:0:18842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90ab94 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836498.235445:0:18842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90ab94 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836498.235457:0:18842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836498.235498:0:18842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07accaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc96480a-9861-42d8-abb0-6f65502ae376+16:3304:x1875730538552064:12345-0@lo:103:ldlm_bl.0 Request processed in 491us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836498.235505:0:18842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788836498.235822:0:18871:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90ab94 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836498.235831:0:18871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90ab94 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836498.235837:0:18871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90ab94 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836498.235908:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc96480a-9861-42d8-abb0-6f65502ae376:3304:1875730538552064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788836498.241936:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04809a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+15:19538:x1875730538551808:12345-0@lo:253:mount.lustre.0 Request processed in 40524us (40645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836498.241950:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788836498.242035:0:19538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:19538:1875730538551808:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788836498.242050:0:19538:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788836498.242052:0:19538:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788836498.242054:0:19538:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788836498.242055:0:19538:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836498.242056:0:19538:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836498.242058:0:19538:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836498.242059:0:19538:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836498.242060:0:19538:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788836498.242062:0:19538:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836498.242063:0:19538:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788836498.242146:0:19538:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788836498.245843:0:19538:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788836498.246005:0:19538:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788836498.246248:0:19538:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788836498.246543:0:19538:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788836498.246679:0:19538:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788836498.246878:0:19538:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788836498.249930:0:19538:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1788836498.293326:0:19538:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788836498.293355:0:19538:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788836498.293389:0:19538:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788836498.293456:0:19538:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788836498.293469:0:19538:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788836498.293495:0:19538:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788836498.323415:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836499.346867:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788836500.243911:0:18853:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788836500.243918:0:18853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bcf46073800 from 10 10000000:01000000:3.0:1788836500.243924:0:18853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788836500.243968:0:18853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040030800/0xcb5b7bc40b90ab9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836500.243981:0:18853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd040030800/0xcb5b7bc40b90ab9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836500.243991:0:18853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd040030800/0xcb5b7bc40b90ab9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836500.244015:0:18853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538552192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788836500.244090:0:18853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836500.246436:0:18853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0467090c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836500.246909:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538552192 00000100:00100000:0.0:1788836500.246921:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538552192 00000100:00100000:0.0:1788836500.246984:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788836500.246994:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04809b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+15:18853:x1875730538552192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836500.247010:0:18849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836500.249459:0:18849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd08217c600/0xcb5b7bc40b90aba2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90ab9b expref: -99 pid: 18849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836500.249503:0:18849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd08217c600/0xcb5b7bc40b90aba2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90ab9b expref: 16 pid: 18849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836500.249524:0:18849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd08217c600/0xcb5b7bc40b90aba2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90ab9b expref: 16 pid: 18849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836500.249534:0:18849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217c600, rc 0) 00000100:00100000:0.0:1788836500.249621:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04809b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+16:18853:x1875730538552192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2627us (5529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836500.249630:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788836500.249764:0:18853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538552192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836500.249782:0:18853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd040030800/0xcb5b7bc40b90ab9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90aba2 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836500.249792:0:18853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd040030800/0xcb5b7bc40b90ab9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90aba2 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836500.249850:0:18853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538552320:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788836500.249905:0:18853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836500.249942:0:18853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0467090c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836500.249961:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538552320 00000100:00100000:0.0:1788836500.249969:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538552320 00000100:00100000:0.0:1788836500.250014:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788836500.250024:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+16:18853:x1875730538552320:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788836500.250042:0:18850:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788836500.250057:0:18850:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788836500.250060:0:18850:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788836500.250147:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+16:18853:x1875730538552320:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836500.250154:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788836500.253128:0:18853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538552320:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788836500.253218:0:18853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788836500.253360:0:18853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040030800/0xcb5b7bc40b90ab9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90aba2 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836500.253372:0:18853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd040030800/0xcb5b7bc40b90ab9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90aba2 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836500.368836:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836501.392935:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836502.416575:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836503.382284:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc96480a-9861-42d8-abb0-6f65502ae376:3305:1875730538552448:0@lo:400:kworker.0 00000100:00100000:1.0:1788836503.382386:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788836503.382487:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836503.382493:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788836503.382496:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836503.382499:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788836503.382558:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538552576:0@lo:400:kworker.0 00000100:00100000:2.0:1788836503.382592:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836503.382625:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788836503.382632:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538552704:0@lo:400:kworker.0 00000100:00100000:2.0:1788836503.382659:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836503.387229:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538552448 00000100:00100000:2.0:1788836503.387246:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538552448 00000100:00100000:2.0:1788836503.387320:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788836503.387330:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44940c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+16:3305:x1875730538552448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836503.389006:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538552576 00000100:00100000:0.0:1788836503.389016:0:18856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538552576 00000100:00100000:0.0:1788836503.389067:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538552704 00000100:00100000:0.0:1788836503.389070:0:18856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538552704 00000100:00100000:0.0:1788836503.389099:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788836503.389106:0:18856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538552576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836503.389190:0:18856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538552576:12345-0@lo:400:kworker.0 Request processed in 84us (6596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836503.389197:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788836503.389214:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788836503.389228:0:18856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538552704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836503.389258:0:18856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538552704:12345-0@lo:400:kworker.0 Request processed in 31us (6597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836503.389263:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788836503.389673:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836503.391017:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44940c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+16:3305:x1875730538552448:12345-0@lo:400:kworker.0 Request processed in 3680us (8624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836503.391031:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1788836503.391377:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd07a3dd500 x1875730538552704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836503.391392:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538552704:0@lo:400:kworker.0 00000100:00100000:1.0:1788836503.391570:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc96480a-9861-42d8-abb0-6f65502ae376:3305:1875730538552448:0@lo:400:kworker.0 00010000:00080000:2.0:1788836503.391637:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd07a3df100 x1875730538552576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836503.391649:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538552576:0@lo:400:kworker.0 00010000:00010000:3.0:1788836503.440579:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788836504.204862:0:19906:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788836504.466309:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836505.494081:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788836506.064995:0:18889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788836506.513997:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836507.538065:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788836508.496540:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836508.496549:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788836508.496551:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836508.496554:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788836508.496565:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788836508.496597:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc96480a-9861-42d8-abb0-6f65502ae376:3305:1875730538552832:0@lo:400:kworker.0 00000100:00100000:2.0:1788836508.496708:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836508.496782:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538552832 00000100:00100000:1.0:1788836508.496793:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538552832 00000100:00100000:2.0:1788836508.496813:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875730538552960:0@lo:400:kworker.0 00000100:00100000:2.0:1788836508.496845:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836508.496858:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788836508.496871:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44942850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+16:3305:x1875730538552832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836508.496893:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538552960 00000100:00100000:2.0:1788836508.496898:0:18856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538552960 00000100:00100000:1.0:1788836508.496945:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44942850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+16:3305:x1875730538552832:12345-0@lo:400:kworker.0 Request processed in 75us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836508.496953:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788836508.497104:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788836508.497113:0:18856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875730538552960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836508.497153:0:18856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875730538552960:12345-0@lo:400:kworker.0 Request processed in 41us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836508.497159:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788836508.497201:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd07a3dd500 x1875730538552960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836508.497216:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875730538552960:0@lo:400:kworker.0 00000100:00100000:2.0:1788836508.497226:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc96480a-9861-42d8-abb0-6f65502ae376:3305:1875730538552832:0@lo:400:kworker.0 00000100:00100000:2.0:1788836508.497286:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538553088:0@lo:400:kworker.0 00000100:00100000:2.0:1788836508.497311:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836508.497372:0:18855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538553088 00000100:00100000:2.0:1788836508.497377:0:18855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538553088 00000100:00100000:2.0:1788836508.497420:0:18855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788836508.497427:0:18856:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788836508.497428:0:18855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538553088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836508.497440:0:18856:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788836508.497471:0:18855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538553088:12345-0@lo:400:kworker.0 Request processed in 44us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836508.497476:0:18855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788836508.497493:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788836508.497512:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd07a3df100 x1875730538553088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836508.497534:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538553088:0@lo:400:kworker.0 00010000:00010000:2.0:1788836508.563528:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836509.456419:0:3301:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836494/real 1788836494] req@ffff9bd07a359880 x1875730538549120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836509 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836509.456451:0:3301:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd07a359880 x1875730538549120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836509 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836509.456460:0:3301:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836494/real 1788836494] req@ffff9bd07ad02300 x1875730538548864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836509 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836509.456470:0:3301:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd07ad02300 x1875730538548864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836509 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788836509.456490:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd07b264800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788836509.456511:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788836509.456514:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538549120:0@lo:8:kworker.0 00000100:00080000:0.0:1788836509.456520:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd07af71000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788836509.456525:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788836509.456528:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538548864:0@lo:8:kworker.0 00000100:00080000:2.0:1788836509.456746:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836509.456751:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788836509.456754:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd07b264800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788836509.456759:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 547 00000100:00080000:2.0:1788836509.456763:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788836509.456769:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bd07b264800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788836509.456790:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd07a3dd180 x1875730538553344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788836509.456801:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836509.456804:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788836509.456806:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd07af71000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788836509.456809:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 547 00000100:00080000:2.0:1788836509.456812:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788836509.456815:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bd07af71000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788836509.456826:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd07a3dea00 x1875730538553472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788836509.456872:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538553600:0@lo:400:kworker.0 00000100:00100000:2.0:1788836509.456942:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836509.457009:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788836509.457015:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538553728:0@lo:400:kworker.0 00000100:00100000:2.0:1788836509.457039:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836509.457087:0:18855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538553600 00000100:00100000:2.0:1788836509.457094:0:18855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538553600 00000100:00100000:2.0:1788836509.457132:0:18855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538553728 00000100:00100000:2.0:1788836509.457135:0:18855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538553728 00000100:00100000:2.0:1788836509.457166:0:18855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788836509.457174:0:18855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538553600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836509.457224:0:18855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538553600:12345-0@lo:400:kworker.0 Request processed in 49us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836509.457231:0:18855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788836509.457247:0:18855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788836509.457266:0:18855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538553728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836509.457297:0:18855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538553728:12345-0@lo:400:kworker.0 Request processed in 44us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836509.457302:0:18855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788836509.457333:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd07a3de680 x1875730538553728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836509.457373:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538553728:0@lo:400:kworker.0 00010000:00080000:2.0:1788836509.457385:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd07a3dd880 x1875730538553600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836509.457394:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538553600:0@lo:400:kworker.0 00000100:00100000:0.0:1788836509.457557:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788836509.457569:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc96480a-9861-42d8-abb0-6f65502ae376:3302:1875730538553216:0@lo:400:kworker.0 00000100:00100000:0.0:1788836509.457606:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836509.457653:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538553344:0@lo:8:kworker.0 00000100:00100000:0.0:1788836509.457677:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836509.457691:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538553472:0@lo:8:kworker.0 00000100:00100000:0.0:1788836509.457707:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836509.458209:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538553216 00000100:00100000:2.0:1788836509.458216:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538553216 00000100:00100000:2.0:1788836509.458271:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788836509.458282:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44940450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+16:3302:x1875730538553216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836509.458406:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44940450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+16:3302:x1875730538553216:12345-0@lo:400:kworker.0 Request processed in 129us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836509.458423:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788836509.458463:0:19539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538553344 00000100:00100000:2.0:1788836509.458467:0:19539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538553344 00000100:00100000:2.0:1788836509.458481:0:19539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538553472 00000100:00100000:2.0:1788836509.458483:0:19539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538553472 00000100:00100000:2.0:1788836509.458492:0:19539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788836509.458497:0:19539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1875730538553344:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788836509.458519:0:19539:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 562 last 0 00000020:00000080:2.0:1788836509.458543:0:19539:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcb5b7bc40b90aba9 00002000:00100000:2.0:1788836509.458556:0:19539:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9bd07a3ac000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396b ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788836509.458561:0:19539:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788836509.458564:0:19539:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788836509.458898:0:19539:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788836509.458926:0:19539:0:(import.c:65:import_set_state_nolock()) ffff9bd07a3aa000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788836509.458972:0:19539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1875730538553344:12345-0@lo:8:kworker.0 Request processed in 473us (1294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836509.458980:0:19539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788836509.458993:0:19539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788836509.458997:0:19539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a35a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1875730538553472:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788836509.459008:0:19539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788836509.464115:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc96480a-9861-42d8-abb0-6f65502ae376:3302:1875730538553216:0@lo:400:kworker.0 00010000:00080000:0.0:1788836509.464181:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd07a3dd180 x1875730538553344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788836529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836509.464192:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788836509.464201:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788836509.464261:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788836509.464268:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788836509.464272:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd07b264800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788836509.464364:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788836509.464371:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538553344:0@lo:8:kworker.0 00000004:00080000:0.0:1788836509.466162:0:18877:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788836509.466606:0:18877:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 562601262424ns, next at 0ns, rc = 0 00000004:00080000:3.0:1788836509.470156:0:18878:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1788836509.470186:0:18878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad02300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18878:1875730538553984:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788836509.470272:0:18878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836509.470303:0:18878:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047fbb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836509.470324:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788836509.470336:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538553856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836509.470376:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836509.470412:0:19543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538553856 00000100:00100000:3.0:1788836509.470419:0:19543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538553856 00000100:00100000:3.0:1788836509.470469:0:19543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788836509.470476:0:19543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875730538553856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788836509.470508:0:19543:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788836509.470547:0:19543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875730538553856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836509.470553:0:19543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788836509.470571:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788836509.470593:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd07ad00a80 x1875730538553856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836525 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836509.470610:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538553856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836509.470633:0:19542:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788836509.470640:0:19542:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788836509.477561:0:19541:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788836509.477585:0:19541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538553984 00000100:00100000:3.0:1788836509.477594:0:19541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538553984 00000100:00100000:0.0:1788836509.478051:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788836509.478061:0:20128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:18878:x1875730538553984:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788836509.484529:0:20128:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788836509.484541:0:20128:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:0.0:1788836509.484546:0:20128:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:65) 00000100:00100000:2.0:1788836509.490574:0:19539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a35a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1875730538553472:12345-0@lo:8:kworker.0 Request processed in 31569us (32860us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788836509.490588:0:19539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788836509.490646:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd07af71000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788836509.490652:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788836509.490657:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538553472:0@lo:8:kworker.0 00002000:00010000:0.0:1788836509.514118:0:20128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788836509.514130:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073bd89ff/0xcb5b7bc40b90abb0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.514148:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788836509.514159:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836509.514165:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073bd89ff/0xcb5b7bc40b90abb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.514183:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073bd89ff/0xcb5b7bc40b90abb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.514192:0:20128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073bd89ff/0xcb5b7bc40b90abb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.514200:0:20128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073bd89ff/0xcb5b7bc40b90abb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.514219:0:20128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836509.514232:0:18843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836509.514237:0:18843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073bd89ff/0xcb5b7bc40b90abb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.514245:0:18843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217d400 already unused, calling callback (ffffffffc1590350) 00010000:00010000:0.0:1788836509.514250:0:18843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073bd89ff/0xcb5b7bc40b90abb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.514270:0:18843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073bd89ff/0xcb5b7bc40b90abb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.514286:0:18843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073bd89ff/0xcb5b7bc40b90abb0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.514305:0:18843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073bd89ff/0xcb5b7bc40b90abb0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.514322:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836509.514324:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836509.514326:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788836509.514872:0:20128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788836509.514879:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000304befc4/0xcb5b7bc40b90abb7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.514888:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788836509.514891:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836509.514895:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000304befc4/0xcb5b7bc40b90abb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.514904:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000304befc4/0xcb5b7bc40b90abb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.514912:0:20128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000304befc4/0xcb5b7bc40b90abb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.514918:0:20128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000304befc4/0xcb5b7bc40b90abb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.514939:0:20128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836509.514987:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836509.514994:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000304befc4/0xcb5b7bc40b90abb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.515003:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217c800 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836509.515006:0:18844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000304befc4/0xcb5b7bc40b90abb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.515014:0:18844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000304befc4/0xcb5b7bc40b90abb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.515029:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000304befc4/0xcb5b7bc40b90abb7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.515035:0:18844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000304befc4/0xcb5b7bc40b90abb7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788836509.515494:0:20128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788836509.515506:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000085b67d7/0xcb5b7bc40b90abbe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.515515:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788836509.515519:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836509.515524:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000085b67d7/0xcb5b7bc40b90abbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.515534:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000085b67d7/0xcb5b7bc40b90abbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.515543:0:20128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000085b67d7/0xcb5b7bc40b90abbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.515550:0:20128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000085b67d7/0xcb5b7bc40b90abbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.515569:0:20128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836509.515774:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836509.515779:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000085b67d7/0xcb5b7bc40b90abbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.515786:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217d200 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836509.515790:0:18844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000085b67d7/0xcb5b7bc40b90abbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.515878:0:18844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000085b67d7/0xcb5b7bc40b90abbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.515892:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000085b67d7/0xcb5b7bc40b90abbe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.515899:0:18844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000085b67d7/0xcb5b7bc40b90abbe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.515911:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836509.515913:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836509.515915:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836509.515972:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788836509.516126:0:20128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788836509.516132:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90abc5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.516141:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788836509.516143:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836509.516147:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90abc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.516156:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90abc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.516170:0:20128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90abc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.516176:0:20128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90abc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.516237:0:20128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788836509.516734:0:20128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788836509.516740:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8f2e6dd/0xcb5b7bc40b90abcc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.516748:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788836509.516751:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836509.516755:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8f2e6dd/0xcb5b7bc40b90abcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.516764:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8f2e6dd/0xcb5b7bc40b90abcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.516772:0:20128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8f2e6dd/0xcb5b7bc40b90abcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.516780:0:20128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8f2e6dd/0xcb5b7bc40b90abcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.517087:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788836509.517095:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90abc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.517103:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217d600 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836509.517112:0:18844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90abc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.517121:0:18844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90abc5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.517134:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90abc5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.517141:0:18844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90abc5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.517156:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836509.517160:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8f2e6dd/0xcb5b7bc40b90abcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.517166:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217c400 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836509.517169:0:18844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8f2e6dd/0xcb5b7bc40b90abcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.517177:0:18844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8f2e6dd/0xcb5b7bc40b90abcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.517186:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8f2e6dd/0xcb5b7bc40b90abcc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.517193:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836509.517199:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836509.517201:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788836509.520126:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788836509.520477:0:20128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788836509.520487:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8f2e6dd/0xcb5b7bc40b90abcc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.520724:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788836509.521301:0:20128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788836509.521309:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000872fe274/0xcb5b7bc40b90abd3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.521324:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788836509.521329:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836509.521335:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000872fe274/0xcb5b7bc40b90abd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.521566:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000872fe274/0xcb5b7bc40b90abd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.521578:0:20128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000872fe274/0xcb5b7bc40b90abd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.521586:0:20128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000872fe274/0xcb5b7bc40b90abd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.521740:0:20128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788836509.522205:0:20128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836509.522212:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002380852e/0xcb5b7bc40b90abda lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.522222:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788836509.522226:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836509.522230:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002380852e/0xcb5b7bc40b90abda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.522240:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002380852e/0xcb5b7bc40b90abda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.522248:0:20128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002380852e/0xcb5b7bc40b90abda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.522268:0:20128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002380852e/0xcb5b7bc40b90abda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.522486:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788836509.522494:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000872fe274/0xcb5b7bc40b90abd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.522503:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217d800 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836509.522508:0:18844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000872fe274/0xcb5b7bc40b90abd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.522518:0:18844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000872fe274/0xcb5b7bc40b90abd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.522536:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000872fe274/0xcb5b7bc40b90abd3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.522543:0:18844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000872fe274/0xcb5b7bc40b90abd3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.522557:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836509.522561:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002380852e/0xcb5b7bc40b90abda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.522567:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978a400 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836509.522570:0:18844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002380852e/0xcb5b7bc40b90abda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.522589:0:18844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002380852e/0xcb5b7bc40b90abda lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.522599:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002380852e/0xcb5b7bc40b90abda lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.522607:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836509.522609:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836509.522611:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836509.522750:0:20128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788836509.522755:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002380852e/0xcb5b7bc40b90abda lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788836509.523205:0:20128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836509.523213:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be65af80/0xcb5b7bc40b90abe1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.523235:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788836509.523239:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836509.523244:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be65af80/0xcb5b7bc40b90abe1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.523268:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be65af80/0xcb5b7bc40b90abe1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.523277:0:20128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be65af80/0xcb5b7bc40b90abe1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.523285:0:20128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be65af80/0xcb5b7bc40b90abe1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.523491:0:18843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836509.523497:0:18843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be65af80/0xcb5b7bc40b90abe1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.523505:0:18843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978b200 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836509.523508:0:18843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be65af80/0xcb5b7bc40b90abe1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.523516:0:18843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be65af80/0xcb5b7bc40b90abe1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.523529:0:18843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be65af80/0xcb5b7bc40b90abe1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.523538:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836509.523540:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836509.523541:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836509.523624:0:20128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788836509.523629:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be65af80/0xcb5b7bc40b90abe1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788836509.524089:0:20128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836509.524096:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b90abe8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.524107:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788836509.524110:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836509.524115:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b90abe8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.524137:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b90abe8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.524147:0:20128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b90abe8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.524155:0:20128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b90abe8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.524310:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836509.524315:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b90abe8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.524320:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978bc00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836509.524322:0:18844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b90abe8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.524328:0:18844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b90abe8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.524336:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b90abe8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.524376:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836509.524379:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836509.524380:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836509.524471:0:20128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788836509.524476:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b90abe8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788836509.524909:0:20128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836509.524916:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1145855/0xcb5b7bc40b90abef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.524925:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788836509.524928:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836509.524932:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1145855/0xcb5b7bc40b90abef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.524941:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1145855/0xcb5b7bc40b90abef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.524959:0:20128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1145855/0xcb5b7bc40b90abef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.524966:0:20128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1145855/0xcb5b7bc40b90abef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.525098:0:18843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836509.525104:0:18843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1145855/0xcb5b7bc40b90abef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.525113:0:18843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978b800 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836509.525116:0:18843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1145855/0xcb5b7bc40b90abef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.525124:0:18843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1145855/0xcb5b7bc40b90abef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.525147:0:18843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1145855/0xcb5b7bc40b90abef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.525155:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836509.525156:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836509.525158:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836509.525222:0:20128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788836509.525227:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1145855/0xcb5b7bc40b90abef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788836509.525694:0:20128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836509.525700:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000887e577/0xcb5b7bc40b90abf6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.525709:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788836509.525712:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836509.525716:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000887e577/0xcb5b7bc40b90abf6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.525726:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000887e577/0xcb5b7bc40b90abf6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.525733:0:20128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000887e577/0xcb5b7bc40b90abf6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.525750:0:20128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000887e577/0xcb5b7bc40b90abf6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.525877:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836509.525883:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000887e577/0xcb5b7bc40b90abf6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.525891:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978b600 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836509.525894:0:18844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000887e577/0xcb5b7bc40b90abf6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.525903:0:18844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000887e577/0xcb5b7bc40b90abf6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.525915:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000887e577/0xcb5b7bc40b90abf6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.525923:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836509.525925:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836509.525926:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836509.525957:0:20128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788836509.525962:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000887e577/0xcb5b7bc40b90abf6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.526425:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836509.526577:0:20128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836509.526583:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006249ccf7/0xcb5b7bc40b90abfd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.526593:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788836509.526596:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836509.526600:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006249ccf7/0xcb5b7bc40b90abfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.526608:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006249ccf7/0xcb5b7bc40b90abfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.526616:0:20128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006249ccf7/0xcb5b7bc40b90abfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.526623:0:20128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006249ccf7/0xcb5b7bc40b90abfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.526741:0:20128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788836509.527138:0:20128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836509.527145:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c74d5d2/0xcb5b7bc40b90ac04 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.527154:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788836509.527158:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836509.527162:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c74d5d2/0xcb5b7bc40b90ac04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.527177:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836509.527177:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c74d5d2/0xcb5b7bc40b90ac04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.527183:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006249ccf7/0xcb5b7bc40b90abfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.527185:0:20128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c74d5d2/0xcb5b7bc40b90ac04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.527193:0:20128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c74d5d2/0xcb5b7bc40b90ac04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.527196:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978ae00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836509.527199:0:18844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006249ccf7/0xcb5b7bc40b90abfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.527207:0:18844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006249ccf7/0xcb5b7bc40b90abfd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.527221:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006249ccf7/0xcb5b7bc40b90abfd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.527228:0:18844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006249ccf7/0xcb5b7bc40b90abfd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.527243:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836509.527246:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c74d5d2/0xcb5b7bc40b90ac04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.527265:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978a200 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836509.527265:0:20128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788836509.527268:0:18844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c74d5d2/0xcb5b7bc40b90ac04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.527275:0:18844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c74d5d2/0xcb5b7bc40b90ac04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.527286:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c74d5d2/0xcb5b7bc40b90ac04 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.527299:0:18844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c74d5d2/0xcb5b7bc40b90ac04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.527312:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836509.527314:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836509.527727:0:20128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836509.527736:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3f43b7c/0xcb5b7bc40b90ac0b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.527744:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788836509.527752:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836509.527757:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3f43b7c/0xcb5b7bc40b90ac0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.527766:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3f43b7c/0xcb5b7bc40b90ac0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.527774:0:20128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3f43b7c/0xcb5b7bc40b90ac0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.527781:0:20128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3f43b7c/0xcb5b7bc40b90ac0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.527824:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836509.527830:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3f43b7c/0xcb5b7bc40b90ac0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.527838:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978a000 already unused, calling callback (ffffffffc1590350) 00010000:00010000:0.0:1788836509.527838:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836509.527841:0:18844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3f43b7c/0xcb5b7bc40b90ac0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.527849:0:18844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3f43b7c/0xcb5b7bc40b90ac0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.527872:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3f43b7c/0xcb5b7bc40b90ac0b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.527881:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836509.527882:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836509.527883:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836509.527945:0:20128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788836509.527950:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3f43b7c/0xcb5b7bc40b90ac0b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.528014:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836509.529297:0:20128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836509.529306:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b62c42c/0xcb5b7bc40b90ac12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.529320:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788836509.529323:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836509.529329:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b62c42c/0xcb5b7bc40b90ac12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.529380:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b62c42c/0xcb5b7bc40b90ac12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.529396:0:20128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b62c42c/0xcb5b7bc40b90ac12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.529403:0:20128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b62c42c/0xcb5b7bc40b90ac12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.529421:0:20128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788836509.529849:0:20128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836509.529864:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6197f35/0xcb5b7bc40b90ac19 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.529873:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788836509.529876:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836509.529880:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6197f35/0xcb5b7bc40b90ac19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.529889:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6197f35/0xcb5b7bc40b90ac19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.529896:0:20128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6197f35/0xcb5b7bc40b90ac19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.529903:0:20128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6197f35/0xcb5b7bc40b90ac19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.529929:0:20128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788836509.530163:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788836509.530163:0:18843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836509.530171:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b62c42c/0xcb5b7bc40b90ac12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.530189:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978be00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836509.530193:0:18844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b62c42c/0xcb5b7bc40b90ac12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.530202:0:18844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b62c42c/0xcb5b7bc40b90ac12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.530217:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b62c42c/0xcb5b7bc40b90ac12 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.530225:0:18844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b62c42c/0xcb5b7bc40b90ac12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.530240:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836509.530242:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836509.530244:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836509.531107:0:20128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836509.531115:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007224f4dd/0xcb5b7bc40b90ac20 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.531128:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788836509.531131:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836509.531136:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007224f4dd/0xcb5b7bc40b90ac20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.531146:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007224f4dd/0xcb5b7bc40b90ac20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.531155:0:20128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007224f4dd/0xcb5b7bc40b90ac20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.531162:0:20128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007224f4dd/0xcb5b7bc40b90ac20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.531187:0:20128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788836509.531624:0:20128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836509.531630:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbcea35b/0xcb5b7bc40b90ac27 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.531639:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788836509.531648:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836509.531652:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbcea35b/0xcb5b7bc40b90ac27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.531662:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbcea35b/0xcb5b7bc40b90ac27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.531670:0:20128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbcea35b/0xcb5b7bc40b90ac27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.531677:0:20128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbcea35b/0xcb5b7bc40b90ac27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.531684:0:20128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788836509.532072:0:20128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836509.532078:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083d2ab13/0xcb5b7bc40b90ac2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.532087:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788836509.532090:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836509.532094:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083d2ab13/0xcb5b7bc40b90ac2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.532103:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083d2ab13/0xcb5b7bc40b90ac2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.532111:0:20128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083d2ab13/0xcb5b7bc40b90ac2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.532124:0:20128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083d2ab13/0xcb5b7bc40b90ac2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.532132:0:20128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788836509.532576:0:20128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836509.532583:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d939247/0xcb5b7bc40b90ac35 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.532591:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788836509.532594:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836509.532599:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d939247/0xcb5b7bc40b90ac35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.532609:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d939247/0xcb5b7bc40b90ac35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.532617:0:20128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d939247/0xcb5b7bc40b90ac35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.532623:0:20128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d939247/0xcb5b7bc40b90ac35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.532632:0:20128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788836509.532997:0:20128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836509.533003:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abb46ce1/0xcb5b7bc40b90ac3c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.533017:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788836509.533020:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836509.533024:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abb46ce1/0xcb5b7bc40b90ac3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.533034:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abb46ce1/0xcb5b7bc40b90ac3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.533042:0:20128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abb46ce1/0xcb5b7bc40b90ac3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.533049:0:20128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abb46ce1/0xcb5b7bc40b90ac3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.533057:0:20128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:3.0:1788836509.534045:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788836509.534055:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007224f4dd/0xcb5b7bc40b90ac20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836509.534073:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978b400 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836509.534078:0:18844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007224f4dd/0xcb5b7bc40b90ac20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836509.534088:0:18844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007224f4dd/0xcb5b7bc40b90ac20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836509.534109:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007224f4dd/0xcb5b7bc40b90ac20 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836509.534117:0:18844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007224f4dd/0xcb5b7bc40b90ac20 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836509.534146:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788836509.534150:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbcea35b/0xcb5b7bc40b90ac27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836509.534156:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0413d3400 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836509.534159:0:18844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbcea35b/0xcb5b7bc40b90ac27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836509.534165:0:18844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbcea35b/0xcb5b7bc40b90ac27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836509.534175:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbcea35b/0xcb5b7bc40b90ac27 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836509.534187:0:18844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbcea35b/0xcb5b7bc40b90ac27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836509.534201:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788836509.534204:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083d2ab13/0xcb5b7bc40b90ac2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836509.534211:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0413d2c00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836509.534214:0:18844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083d2ab13/0xcb5b7bc40b90ac2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836509.534220:0:18844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083d2ab13/0xcb5b7bc40b90ac2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836509.534229:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083d2ab13/0xcb5b7bc40b90ac2e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836509.534236:0:18844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083d2ab13/0xcb5b7bc40b90ac2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836509.534246:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788836509.534249:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d939247/0xcb5b7bc40b90ac35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836509.534266:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0413d3a00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836509.534286:0:18844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d939247/0xcb5b7bc40b90ac35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836509.534295:0:18844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d939247/0xcb5b7bc40b90ac35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836509.534306:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d939247/0xcb5b7bc40b90ac35 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836509.534314:0:18844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d939247/0xcb5b7bc40b90ac35 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836509.534326:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836509.534330:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abb46ce1/0xcb5b7bc40b90ac3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836509.534336:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0413d2400 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836509.534339:0:18844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abb46ce1/0xcb5b7bc40b90ac3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836509.534365:0:18844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abb46ce1/0xcb5b7bc40b90ac3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836509.534375:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abb46ce1/0xcb5b7bc40b90ac3c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836509.534381:0:18844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abb46ce1/0xcb5b7bc40b90ac3c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836509.534402:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836509.534404:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836509.534406:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836509.534600:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836509.534610:0:18843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6197f35/0xcb5b7bc40b90ac19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.534620:0:18843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978a600 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836509.534623:0:18843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6197f35/0xcb5b7bc40b90ac19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.534630:0:18843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6197f35/0xcb5b7bc40b90ac19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.534645:0:18843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6197f35/0xcb5b7bc40b90ac19 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.534650:0:18843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6197f35/0xcb5b7bc40b90ac19 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.534664:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836509.534665:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836509.534667:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836509.534671:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836509.534673:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836509.538339:0:20128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836509.538382:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cba60b55/0xcb5b7bc40b90ac43 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.538401:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788836509.538406:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836509.538413:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cba60b55/0xcb5b7bc40b90ac43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.538426:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cba60b55/0xcb5b7bc40b90ac43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.538449:0:20128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cba60b55/0xcb5b7bc40b90ac43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.538457:0:20128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cba60b55/0xcb5b7bc40b90ac43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.538471:0:20128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836509.538963:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836509.538971:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cba60b55/0xcb5b7bc40b90ac43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836509.538980:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0413d2a00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836509.538984:0:18844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cba60b55/0xcb5b7bc40b90ac43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836509.538994:0:18844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cba60b55/0xcb5b7bc40b90ac43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836509.539012:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cba60b55/0xcb5b7bc40b90ac43 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836509.539020:0:18844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cba60b55/0xcb5b7bc40b90ac43 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836509.539041:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836509.539043:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836509.539044:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836509.542183:0:20128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836509.542198:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6dcd426/0xcb5b7bc40b90ac4a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.542214:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788836509.542219:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836509.542225:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6dcd426/0xcb5b7bc40b90ac4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.542239:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6dcd426/0xcb5b7bc40b90ac4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.542250:0:20128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6dcd426/0xcb5b7bc40b90ac4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.542270:0:20128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6dcd426/0xcb5b7bc40b90ac4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.542304:0:20128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788836509.542801:0:20128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836509.542807:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035ca88f0/0xcb5b7bc40b90ac51 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.542816:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788836509.542819:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836509.542823:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035ca88f0/0xcb5b7bc40b90ac51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.542832:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035ca88f0/0xcb5b7bc40b90ac51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.542840:0:20128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035ca88f0/0xcb5b7bc40b90ac51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.542847:0:20128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035ca88f0/0xcb5b7bc40b90ac51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.542870:0:20128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788836509.542893:0:20131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788836509.542901:0:20131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6dcd426/0xcb5b7bc40b90ac4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.542909:0:20131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0413d2000 already unused, calling callback (ffffffffc1590350) 00010000:00010000:0.0:1788836509.542913:0:20131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6dcd426/0xcb5b7bc40b90ac4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.542922:0:20131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6dcd426/0xcb5b7bc40b90ac4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.542941:0:20131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6dcd426/0xcb5b7bc40b90ac4a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.542948:0:20131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6dcd426/0xcb5b7bc40b90ac4a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.542967:0:20131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836509.542970:0:20131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035ca88f0/0xcb5b7bc40b90ac51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.542977:0:20131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0413d3600 already unused, calling callback (ffffffffc1590350) 00010000:00010000:0.0:1788836509.542980:0:20131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035ca88f0/0xcb5b7bc40b90ac51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.542987:0:20131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035ca88f0/0xcb5b7bc40b90ac51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.543020:0:20131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035ca88f0/0xcb5b7bc40b90ac51 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.543029:0:20131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035ca88f0/0xcb5b7bc40b90ac51 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.543044:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836509.543046:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836509.543047:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836509.543269:0:20128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836509.543275:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094695aab/0xcb5b7bc40b90ac58 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.543283:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788836509.543291:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836509.543296:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094695aab/0xcb5b7bc40b90ac58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.543306:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094695aab/0xcb5b7bc40b90ac58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.543314:0:20128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094695aab/0xcb5b7bc40b90ac58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.543321:0:20128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094695aab/0xcb5b7bc40b90ac58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.543363:0:20128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836509.543394:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836509.543400:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094695aab/0xcb5b7bc40b90ac58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.543407:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0413d2800 already unused, calling callback (ffffffffc1590350) 00010000:00010000:0.0:1788836509.543411:0:18844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094695aab/0xcb5b7bc40b90ac58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.543419:0:18844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094695aab/0xcb5b7bc40b90ac58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.543430:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094695aab/0xcb5b7bc40b90ac58 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.543437:0:18844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094695aab/0xcb5b7bc40b90ac58 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.543467:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836509.543469:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836509.543471:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836509.543736:0:20128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836509.543742:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005af26368/0xcb5b7bc40b90ac5f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.543751:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788836509.543755:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836509.543759:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005af26368/0xcb5b7bc40b90ac5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.543768:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005af26368/0xcb5b7bc40b90ac5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.543776:0:20128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005af26368/0xcb5b7bc40b90ac5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.543789:0:20128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005af26368/0xcb5b7bc40b90ac5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.543808:0:20128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836509.543958:0:20131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836509.543963:0:20131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005af26368/0xcb5b7bc40b90ac5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.543971:0:20131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0413d2600 already unused, calling callback (ffffffffc1590350) 00010000:00010000:0.0:1788836509.543974:0:20131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005af26368/0xcb5b7bc40b90ac5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.543982:0:20131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005af26368/0xcb5b7bc40b90ac5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.543993:0:20131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005af26368/0xcb5b7bc40b90ac5f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.544000:0:20131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005af26368/0xcb5b7bc40b90ac5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.544024:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836509.544026:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836509.544027:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836509.544191:0:20128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836509.544197:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000663cf281/0xcb5b7bc40b90ac66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.544205:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788836509.544208:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836509.544212:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000663cf281/0xcb5b7bc40b90ac66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.544220:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000663cf281/0xcb5b7bc40b90ac66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.544228:0:20128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000663cf281/0xcb5b7bc40b90ac66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.544235:0:20128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000663cf281/0xcb5b7bc40b90ac66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.547428:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836509.547443:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000663cf281/0xcb5b7bc40b90ac66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.547475:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376600 already unused, calling callback (ffffffffc1590350) 00010000:00010000:0.0:1788836509.547480:0:18844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000663cf281/0xcb5b7bc40b90ac66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.547491:0:18844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000663cf281/0xcb5b7bc40b90ac66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.547512:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000663cf281/0xcb5b7bc40b90ac66 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.547522:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836509.547524:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836509.547525:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836509.547740:0:20128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788836509.547749:0:20128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000663cf281/0xcb5b7bc40b90ac66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.550020:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788836509.550656:0:20128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788836509.551154:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8f2e6dd/0xcb5b7bc40b90ac6d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.551172:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788836509.551177:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836509.551184:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8f2e6dd/0xcb5b7bc40b90ac6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.551199:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8f2e6dd/0xcb5b7bc40b90ac6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.551210:0:20128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8f2e6dd/0xcb5b7bc40b90ac6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.551225:0:20128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8f2e6dd/0xcb5b7bc40b90ac6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.551249:0:20128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836509.552139:0:20131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836509.552149:0:20131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8f2e6dd/0xcb5b7bc40b90ac6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.552159:0:20131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217c400 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836509.552164:0:20131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8f2e6dd/0xcb5b7bc40b90ac6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.552173:0:20131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8f2e6dd/0xcb5b7bc40b90ac6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.552192:0:20131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8f2e6dd/0xcb5b7bc40b90ac6d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.552199:0:20131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8f2e6dd/0xcb5b7bc40b90ac6d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.552217:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836509.552219:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836509.552221:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788836509.552897:0:20128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788836509.552907:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073bd89ff/0xcb5b7bc40b90ac74 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.552920:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788836509.552923:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836509.552929:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073bd89ff/0xcb5b7bc40b90ac74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.552938:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073bd89ff/0xcb5b7bc40b90ac74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.552947:0:20128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073bd89ff/0xcb5b7bc40b90ac74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.552953:0:20128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073bd89ff/0xcb5b7bc40b90ac74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.552976:0:20128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836509.553270:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836509.553277:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073bd89ff/0xcb5b7bc40b90ac74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.553285:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217d400 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836509.553289:0:18844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073bd89ff/0xcb5b7bc40b90ac74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.553297:0:18844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073bd89ff/0xcb5b7bc40b90ac74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.553311:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073bd89ff/0xcb5b7bc40b90ac74 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.553333:0:18844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073bd89ff/0xcb5b7bc40b90ac74 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.553415:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836509.553417:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836509.553419:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788836509.556986:0:20128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788836509.556997:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b05d1/0xcb5b7bc40b90ac7b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.557150:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788836509.557155:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836509.557161:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b05d1/0xcb5b7bc40b90ac7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.557177:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b05d1/0xcb5b7bc40b90ac7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.557188:0:20128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b05d1/0xcb5b7bc40b90ac7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.557196:0:20128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b05d1/0xcb5b7bc40b90ac7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.557223:0:20128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836509.557287:0:18843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836509.557295:0:18843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b05d1/0xcb5b7bc40b90ac7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.557303:0:18843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217dc00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836509.557307:0:18843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b05d1/0xcb5b7bc40b90ac7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.557316:0:18843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b05d1/0xcb5b7bc40b90ac7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.557333:0:18843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b05d1/0xcb5b7bc40b90ac7b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.557339:0:18843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b05d1/0xcb5b7bc40b90ac7b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.557368:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836509.557370:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836509.557372:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788836509.558202:0:20128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788836509.558211:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f89aaff/0xcb5b7bc40b90ac82 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.558222:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788836509.558226:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836509.558231:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f89aaff/0xcb5b7bc40b90ac82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.558242:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f89aaff/0xcb5b7bc40b90ac82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.558274:0:20128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f89aaff/0xcb5b7bc40b90ac82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.558281:0:20128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f89aaff/0xcb5b7bc40b90ac82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.558302:0:20128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836509.558753:0:20131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836509.558761:0:20131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f89aaff/0xcb5b7bc40b90ac82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.558769:0:20131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217d000 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836509.558780:0:20131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f89aaff/0xcb5b7bc40b90ac82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.558789:0:20131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f89aaff/0xcb5b7bc40b90ac82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.558804:0:20131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f89aaff/0xcb5b7bc40b90ac82 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.558812:0:20131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f89aaff/0xcb5b7bc40b90ac82 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836509.558831:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836509.558832:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836509.558834:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788836509.558979:0:20128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788836509.558985:0:20128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afb1dc10/0xcb5b7bc40b90ac89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.558994:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788836509.558998:0:20128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836509.559003:0:20128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afb1dc10/0xcb5b7bc40b90ac89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.559423:0:20128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afb1dc10/0xcb5b7bc40b90ac89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.559433:0:20128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afb1dc10/0xcb5b7bc40b90ac89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.559440:0:20128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afb1dc10/0xcb5b7bc40b90ac89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836509.559471:0:20128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836509.559542:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836509.559549:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afb1dc10/0xcb5b7bc40b90ac89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.559557:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217c200 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836509.559561:0:18844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afb1dc10/0xcb5b7bc40b90ac89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.559568:0:18844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afb1dc10/0xcb5b7bc40b90ac89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.559580:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afb1dc10/0xcb5b7bc40b90ac89 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.559588:0:18844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afb1dc10/0xcb5b7bc40b90ac89 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836509.559603:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836509.559605:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836509.559606:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788836509.560443:0:20128:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:0.0:1788836509.560542:0:20128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:18878:x1875730538553984:12345-0@lo:5:osp-pre-0-0.0 Request processed in 82478us (90267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836509.560553:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788836509.561493:0:18878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad02300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18878:1875730538553984:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788836509.561510:0:18878:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x41:0x0] from OST, last_created [0x240000400:0x41:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:2.0:1788836509.561560:0:18878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18878:1875730538554112:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788836509.561602:0:18878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836509.561660:0:18878:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0496b60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836509.561884:0:19541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538554112 00000100:00100000:0.0:1788836509.561891:0:19541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538554112 00000100:00100000:0.0:1788836509.561968:0:19541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788836509.561978:0:19541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:18878:x1875730538554112:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788836509.562019:0:19541:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 66 00000100:00100000:2.0:1788836509.570183:0:19541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:18878:x1875730538554112:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8198us (8572us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788836509.570206:0:19541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788836509.572920:0:18878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18878:1875730538554112:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788836509.572940:0:18878:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x41:0x0]-[0x240000400:0x61:0x0] 00010000:00010000:2.0:1788836509.585102:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836510.608610:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836511.633499:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788836511.852684:0:20260:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788836511.852689:0:20260:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788836511.852830:0:20260:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bd07a3ae800 00000020:01000004:2.0:1788836511.852852:0:20260:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788836511.852873:0:20260:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788836511.852918:0:20260:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9bcf45d219b8) 00000020:00000080:2.0:1788836511.852941:0:20260:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788836511.902747:0:20260:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788836511.903167:0:20260:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788836511.910051:0:20260:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788836511.910695:0:20260:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788836511.910959:0:20260:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:1.0:1788836511.912212:0:20260:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 467: rc = 0 00100000:10000000:1.0:1788836511.912335:0:20260:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 467: rc = 0 00100000:10000000:1.0:1788836511.912460:0:20260:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 467: rc = 0 00100000:10000000:1.0:1788836511.914723:0:20260:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 604: rc = 0 00100000:10000000:1.0:1788836511.915048:0:20260:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 604: rc = 0 00100000:10000000:1.0:1788836511.915624:0:20260:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 604: rc = 0 00100000:10000000:1.0:1788836511.915874:0:20260:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 604: rc = 0 00100000:10000000:1.0:1788836511.916187:0:20260:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 604: rc = 0 00100000:10000000:1.0:1788836511.916772:0:20260:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 604: rc = 0 00000020:00000080:2.0:1788836511.920265:0:20260:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788836511.920284:0:20260:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788836511.920301:0:20260:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcb5b7bc40b90ac97 00000020:01000004:2.0:1788836511.920316:0:20260:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788836511.920502:0:20260:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.152@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788836511.920507:0:20260:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788836511.920514:0:20260:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788836511.920542:0:20260:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788836511.920547:0:20260:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788836511.935747:0:20260:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788836511.935808:0:20260:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.152@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788836511.935814:0:20260:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788836511.935816:0:20260:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788836511.935817:0:20260:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836511.935819:0:20260:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836511.935820:0:20260:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836511.935821:0:20260:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836511.935823:0:20260:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788836511.935825:0:20260:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836511.935826:0:20260:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788836511.935831:0:20260:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788836511.935833:0:20260:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788836511.935834:0:20260:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788836511.935836:0:20260:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836511.935837:0:20260:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836511.935838:0:20260:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836511.935839:0:20260:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836511.935840:0:20260:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788836511.935842:0:20260:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836511.935843:0:20260:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788836511.935876:0:20260:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788836511.935905:0:20260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad00a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538554240:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788836511.936004:0:20260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836511.936552:0:20260:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd04577b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788836511.944737:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538554240 00000100:00100000:1.0:1788836511.944762:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538554240 00000100:00100000:1.0:1788836511.944872:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788836511.944887:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44941050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+16:20260:x1875730538554240:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788836511.944981:0:18850:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788836511.944985:0:18850:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788836511.944991:0:18850:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788836511.976726:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44941050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+16:20260:x1875730538554240:12345-0@lo:253:mount.lustre.0 Request processed in 31828us (40707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836511.976746:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788836511.977853:0:20260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad00a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538554240:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788836511.977874:0:20260:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788836511.977878:0:20260:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788836511.977880:0:20260:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788836511.977881:0:20260:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836511.977882:0:20260:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836511.977883:0:20260:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836511.977885:0:20260:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836511.977886:0:20260:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788836511.977889:0:20260:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836511.977891:0:20260:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788836511.977941:0:20260:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bd07a3ae800 from lustre-OST0001 10000000:01000000:3.0:1788836511.977977:0:20260:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788836511.977980:0:20260:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788836511.977991:0:20260:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bd07d37cd28 local copy 00010000:00010000:3.0:1788836511.978003:0:20260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040031a00/0xcb5b7bc40b90aa21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90aa28 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836511.978801:0:20260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538554368:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836511.978873:0:20260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836511.978925:0:20260:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd050739f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788836511.978995:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538554368 00000100:00100000:3.0:1788836511.979003:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538554368 00000100:00100000:3.0:1788836511.979171:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788836511.979304:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44940050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+16:20260:x1875730538554368:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788836511.979568:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44940050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+16:20260:x1875730538554368:12345-0@lo:501:mount.lustre.0 Request processed in 386us (693us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788836511.979576:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788836511.979738:0:20260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538554368:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788836511.979759:0:20260:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788836511.979920:0:20260:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788836511.979930:0:20260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040031a00/0xcb5b7bc40b90aa21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90aa28 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836511.979941:0:20260:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd040031a00/0xcb5b7bc40b90aa21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90aa28 expref: -99 pid: 18836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836511.979971:0:20260:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bd07a3ae800 10000000:01000000:1.0:1788836511.979977:0:20260:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788836511.979983:0:20260:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788836511.979986:0:20260:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788836511.980089:0:20260:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788836511.980093:0:20260:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788836511.980188:0:20260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd060376a00/0xcb5b7bc40b90ac9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836511.980197:0:20260:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd060376a00/0xcb5b7bc40b90ac9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836511.980216:0:20260:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd060376a00/0xcb5b7bc40b90ac9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836511.980751:0:20260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538554496:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788836511.980806:0:20260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836511.980904:0:20260:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd043158d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788836511.983479:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538554496 00000100:00100000:0.0:1788836511.983498:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538554496 00000100:00100000:0.0:1788836511.983581:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788836511.983592:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+16:20260:x1875730538554496:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788836511.983623:0:18850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836511.983650:0:18850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd08217c800/0xcb5b7bc40b90aca5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90ac9e expref: -99 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836511.983699:0:18850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd08217c800/0xcb5b7bc40b90aca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90ac9e expref: 17 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836511.983713:0:18850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd08217c800/0xcb5b7bc40b90aca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90ac9e expref: 17 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836511.983762:0:18850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217c800, rc 0) 00000100:00100000:0.0:1788836511.984014:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+17:20260:x1875730538554496:12345-0@lo:101:mount.lustre.0 Request processed in 423us (3207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836511.984022:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788836511.986297:0:20260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538554496:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836511.986333:0:20260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd060376a00/0xcb5b7bc40b90ac9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90aca5 expref: -99 pid: 20260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836511.986370:0:20260:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd060376a00/0xcb5b7bc40b90ac9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90aca5 expref: -99 pid: 20260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788836511.990850:0:20260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:1.0:1788836511.995397:0:20260:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788836511.995637:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788836511.995667:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1788836511.995684:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1788836511.995723:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1788836511.995743:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1788836511.995759:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1788836511.995785:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1788836511.995816:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1788836511.995860:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:1.0:1788836511.995921:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:1.0:1788836511.995926:0:20260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:1.0:1788836511.996045:0:20260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538554624:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836511.996133:0:20260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836511.996766:0:20260:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd043c63b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788836511.997470:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538554624 00000100:00100000:2.0:1788836511.997481:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538554624 00000100:00100000:2.0:1788836511.997606:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788836511.997770:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+17:20260:x1875730538554624:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836512.000078:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+17:20260:x1875730538554624:12345-0@lo:501:mount.lustre.0 Request processed in 2299us (3931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836512.000094:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788836512.000120:0:20260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538554624:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836512.000188:0:20260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538554752:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788836512.000261:0:20260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836512.000309:0:20260:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd043c63b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788836512.000440:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538554752 00000100:00100000:0.0:1788836512.000449:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538554752 00000100:00100000:0.0:1788836512.000509:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788836512.000519:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+17:20260:x1875730538554752:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788836512.000948:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+17:20260:x1875730538554752:12345-0@lo:503:mount.lustre.0 Request processed in 430us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836512.000954:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788836512.001390:0:20260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538554752:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788836512.004329:0:20260:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788836512.004480:0:20260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538554880:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788836512.004581:0:20260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836512.004953:0:20260:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd050739c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788836512.005064:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538554880 00000100:00100000:0.0:1788836512.005074:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538554880 00000100:00100000:0.0:1788836512.005198:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788836512.005211:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44943450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+17:20260:x1875730538554880:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836512.006123:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44943450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+17:20260:x1875730538554880:12345-0@lo:502:mount.lustre.0 Request processed in 902us (1529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836512.006133:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788836512.006784:0:20260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538554880:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788836512.007274:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788836512.007340:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1788836512.007398:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1788836512.007441:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1788836512.007490:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1788836512.007525:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1788836512.007570:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1788836512.007605:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1788836512.007728:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1788836512.007778:0:20260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538555008:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788836512.007853:0:20260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836512.007976:0:20260:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd050739c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788836512.008096:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538555008 00000100:00100000:3.0:1788836512.008105:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538555008 00000100:00100000:3.0:1788836512.008293:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788836512.008304:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44942c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+17:20260:x1875730538555008:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836512.008794:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44942c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+17:20260:x1875730538555008:12345-0@lo:502:mount.lustre.0 Request processed in 490us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836512.008803:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788836512.008893:0:20260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538555008:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788836512.008983:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1788836512.009212:0:20260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1788836512.011296:0:20261:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788836512.011312:0:20261:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788836512.011321:0:20261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836512.011323:0:20261:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788836512.011331:0:20261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788836512.011482:0:20261:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9bcf45d23370) 00000020:00000080:2.0:1788836512.011512:0:20261:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788836512.011519:0:20261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788836512.011598:0:20261:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd07a3ae800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788836512.011678:0:20261:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788836512.011686:0:20261:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcb5b7bc40b90acb3 00010000:00010000:2.0:1788836512.020187:0:20261:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1788836512.021087:0:20261:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934605 00080000:10000000:2.0:1788836512.025558:0:20261:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:1.0:1788836512.027186:0:20261:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788836512.027202:0:20261:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836512.027210:0:20261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836512.027212:0:20261:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788836512.027219:0:20261:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836512.027224:0:20261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836512.027225:0:20261:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788836512.027228:0:20261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788836512.027231:0:20261:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788836512.027233:0:20261:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836512.027246:0:20261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836512.027248:0:20261:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788836512.027251:0:20261:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836512.027253:0:20261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836512.027254:0:20261:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788836512.027258:0:20261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788836512.027332:0:20261:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836512.027335:0:20261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836512.027336:0:20261:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788836512.027340:0:20261:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1788836512.027804:0:20260:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788836512.027853:0:20260:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788836512.027878:0:20260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd060376a00/0xcb5b7bc40b90ac9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90aca5 expref: -99 pid: 20260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836512.027892:0:20260:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd060376a00/0xcb5b7bc40b90ac9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90aca5 expref: -99 pid: 20260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836512.027911:0:20260:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd07a3ae800 from 1 10000000:01000000:3.0:1788836512.027915:0:20260:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788836512.027963:0:20260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b90acba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836512.027971:0:20260:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b90acba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836512.027983:0:20260:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b90acba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836512.028023:0:20260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad00a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538555136:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788836512.028106:0:20260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836512.028154:0:20260:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788836512.030558:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538555136 00000100:00100000:1.0:1788836512.030577:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538555136 00000100:00100000:1.0:1788836512.030852:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788836512.030865:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44942050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+17:20260:x1875730538555136:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836512.030907:0:18849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836512.030932:0:18849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd060377000/0xcb5b7bc40b90acc1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90acba expref: -99 pid: 18849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836512.030966:0:18849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd060377000/0xcb5b7bc40b90acc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90acba expref: 18 pid: 18849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836512.031177:0:18849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd060377000/0xcb5b7bc40b90acc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90acba expref: 18 pid: 18849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836512.031189:0:18849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd060377000, rc 0) 00000100:00100000:1.0:1788836512.031300:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44942050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+18:20260:x1875730538555136:12345-0@lo:101:mount.lustre.0 Request processed in 438us (3193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836512.031307:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788836512.032744:0:20260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad00a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538555136:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788836512.032777:0:20260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b90acba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90acc1 expref: -99 pid: 20260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836512.032790:0:20260:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b90acba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90acc1 expref: -99 pid: 20260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788836512.041805:0:20260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:3.0:1788836512.044921:0:20260:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788836512.045596:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788836512.046504:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1788836512.046574:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1788836512.046617:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1788836512.046647:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1788836512.046706:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1788836512.046737:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1788836512.046771:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1788836512.046858:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1788836512.046866:0:20260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:3.0:1788836512.047018:0:20260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad00a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538555264:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788836512.047106:0:20260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836512.047174:0:20260:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788836512.047419:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538555264 00000100:00100000:1.0:1788836512.047429:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538555264 00000100:00100000:1.0:1788836512.047490:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788836512.047501:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44940850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+18:20260:x1875730538555264:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836512.047798:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44940850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+18:20260:x1875730538555264:12345-0@lo:501:mount.lustre.0 Request processed in 298us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836512.047806:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788836512.048124:0:20260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad00a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538555264:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788836512.048169:0:20260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad00a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538555392:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788836512.048217:0:20260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836512.048260:0:20260:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788836512.048388:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538555392 00000100:00100000:1.0:1788836512.048394:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538555392 00000100:00100000:1.0:1788836512.048435:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788836512.048443:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+18:20260:x1875730538555392:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788836512.048643:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+18:20260:x1875730538555392:12345-0@lo:503:mount.lustre.0 Request processed in 200us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836512.048661:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788836512.048709:0:20260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad00a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538555392:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788836512.049715:0:20260:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788836512.049812:0:20260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538555520:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836512.049888:0:20260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836512.049941:0:20260:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd045cff3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836512.050026:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538555520 00000100:00100000:3.0:1788836512.050033:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538555520 00000100:00100000:3.0:1788836512.050076:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788836512.050086:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44943850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+18:20260:x1875730538555520:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836512.050301:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44943850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+18:20260:x1875730538555520:12345-0@lo:502:mount.lustre.0 Request processed in 215us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836512.050309:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788836512.050862:0:20260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538555520:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788836512.051195:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788836512.051264:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1788836512.051318:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1788836512.051392:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1788836512.052204:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1788836512.052289:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1788836512.052326:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1788836512.052380:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:1.0:1788836512.052596:0:20260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538555648:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836512.052750:0:20260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836512.052855:0:20260:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd045cff3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836512.056171:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538555648 00000100:00100000:3.0:1788836512.056191:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538555648 00000100:00100000:3.0:1788836512.056326:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788836512.056339:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0442c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+18:20260:x1875730538555648:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836512.056914:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0442c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+18:20260:x1875730538555648:12345-0@lo:502:mount.lustre.0 Request processed in 576us (4162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836512.056924:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788836512.057533:0:20260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538555648:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788836512.057824:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1788836512.057850:0:20260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788836512.060251:0:20265:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836512.060284:0:20265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836512.060287:0:20265:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788836512.060296:0:20265:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd07a3ae800 00000020:00000080:3.0:1788836512.060300:0:20265:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788836512.060310:0:20265:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836512.060313:0:20265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836512.060314:0:20265:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788836512.060317:0:20265:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836512.060320:0:20265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836512.060321:0:20265:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788836512.060324:0:20265:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd07a3ae800 00000020:00000080:3.0:1788836512.060326:0:20265:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788836512.060451:0:20265:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836512.060455:0:20265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836512.060457:0:20265:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788836512.060459:0:20265:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836512.060461:0:20265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836512.060463:0:20265:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788836512.060466:0:20265:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd07a3ae800 00000020:00000080:3.0:1788836512.060468:0:20265:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788836512.060509:0:20265:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836512.060512:0:20265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836512.060513:0:20265:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788836512.060517:0:20265:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:1.0:1788836512.060765:0:20260:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788836512.060797:0:20260:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788836512.060820:0:20260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b90acba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90acc1 expref: -99 pid: 20260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836512.060848:0:20260:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b90acba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90acc1 expref: -99 pid: 20260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836512.060898:0:20260:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788836512.060901:0:20260:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bd07a3ae800 10000000:01000000:1.0:1788836512.060904:0:20260:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bd07a3ae800 10000000:01000000:1.0:1788836512.060909:0:20260:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788836512.060916:0:20260:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd07a3ae800 from 1 10000000:01000000:1.0:1788836512.060919:0:20260:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788836512.060964:0:20260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd060377a00/0xcb5b7bc40b90acc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836512.060971:0:20260:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd060377a00/0xcb5b7bc40b90acc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836512.060984:0:20260:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd060377a00/0xcb5b7bc40b90acc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836512.061027:0:20260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538555776:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788836512.061133:0:20260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836512.061191:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538555776 00000100:00100000:1.0:1788836512.061199:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538555776 00000100:00100000:1.0:1788836512.061260:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788836512.061271:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45b7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+18:20260:x1875730538555776:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836512.061289:0:18849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836512.061305:0:18849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b90accf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90acc8 expref: -99 pid: 18849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836512.061382:0:18849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b90accf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90acc8 expref: 19 pid: 18849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836512.061407:0:18849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b90accf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90acc8 expref: 19 pid: 18849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836512.061417:0:18849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd060376000, rc 0) 00000100:00100000:1.0:1788836512.061457:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45b7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+19:20260:x1875730538555776:12345-0@lo:101:mount.lustre.0 Request processed in 188us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836512.061465:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788836512.061537:0:20260:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd045cffcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836512.061565:0:20260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538555776:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836512.061583:0:20260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd060377a00/0xcb5b7bc40b90acc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90accf expref: -99 pid: 20260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836512.061593:0:20260:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd060377a00/0xcb5b7bc40b90acc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90accf expref: -99 pid: 20260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788836512.067389:0:20260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:1.0:1788836512.069175:0:20260:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788836512.071773:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788836512.071933:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1788836512.071972:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1788836512.072106:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1788836512.072208:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1788836512.072271:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1788836512.072306:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1788836512.072335:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1788836512.073792:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1788836512.073831:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1788836512.073866:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1788836512.073916:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1788836512.073952:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1788836512.073986:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1788836512.074840:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1788836512.074892:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1788836512.074926:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1788836512.074977:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1788836512.076172:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1788836512.076229:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1788836512.076318:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1788836512.076380:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1788836512.077216:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1788836512.077305:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1788836512.077392:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:1.0:1788836512.078389:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:1.0:1788836512.078480:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:1.0:1788836512.078520:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:1.0:1788836512.078553:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:1.0:1788836512.078619:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:1.0:1788836512.078662:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:1.0:1788836512.078696:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:1.0:1788836512.078730:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:1.0:1788836512.078797:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:1.0:1788836512.078836:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:1.0:1788836512.078883:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:1.0:1788836512.078918:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:1.0:1788836512.078953:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:1.0:1788836512.079018:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:1.0:1788836512.079056:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:1.0:1788836512.083599:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:1.0:1788836512.083864:0:20260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:1.0:1788836512.084010:0:20260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538555904:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836512.084096:0:20260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836512.084217:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538555904 00000100:00100000:1.0:1788836512.084226:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538555904 00000100:00100000:1.0:1788836512.084289:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788836512.084299:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45b7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+19:20260:x1875730538555904:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836512.087318:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45b7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+19:20260:x1875730538555904:12345-0@lo:501:mount.lustre.0 Request processed in 3007us (3209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836512.087335:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788836512.087508:0:20260:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd045cffcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836512.087541:0:20260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538555904:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836512.087941:0:20260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538556032:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788836512.088008:0:20260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836512.088044:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538556032 00000100:00100000:1.0:1788836512.088052:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538556032 00000100:00100000:1.0:1788836512.088097:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788836512.088107:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45b7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+19:20260:x1875730538556032:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788836512.088322:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45b7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+19:20260:x1875730538556032:12345-0@lo:503:mount.lustre.0 Request processed in 216us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836512.088330:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788836512.088417:0:20260:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd045cffcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836512.088435:0:20260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538556032:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788836512.091185:0:20260:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788836512.091320:0:20260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538556160:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836512.091454:0:20260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836512.091505:0:20260:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bcf45b32d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788836512.091673:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538556160 00000100:00100000:3.0:1788836512.091682:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538556160 00000100:00100000:3.0:1788836512.091739:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788836512.091750:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45b7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+19:20260:x1875730538556160:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836512.092025:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45b7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+19:20260:x1875730538556160:12345-0@lo:502:mount.lustre.0 Request processed in 276us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836512.092034:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788836512.092189:0:20260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538556160:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788836512.092496:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788836512.092551:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1788836512.092588:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1788836512.092813:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1788836512.092898:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1788836512.092951:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1788836512.092987:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1788836512.093020:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1788836512.093099:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788836512.093137:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1788836512.093171:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1788836512.093215:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1788836512.093280:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1788836512.093313:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1788836512.093389:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1788836512.093425:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1788836512.093460:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1788836512.093507:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1788836512.093540:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1788836512.093572:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1788836512.097275:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1788836512.097438:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1788836512.097474:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1788836512.097544:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1788836512.097579:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:1.0:1788836512.097840:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:1.0:1788836512.097909:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:1.0:1788836512.097947:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:1.0:1788836512.098006:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:1.0:1788836512.098056:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:1.0:1788836512.098137:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:1.0:1788836512.098170:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:1.0:1788836512.098202:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:1.0:1788836512.098322:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:1.0:1788836512.098411:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:1.0:1788836512.098457:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:1.0:1788836512.098485:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:1.0:1788836512.098511:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:1.0:1788836512.098548:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:1.0:1788836512.098578:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:1.0:1788836512.098777:0:20260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538556288:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836512.098925:0:20260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836512.098978:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538556288 00000100:00100000:1.0:1788836512.098987:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538556288 00000100:00100000:1.0:1788836512.099048:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788836512.099058:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45b7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+19:20260:x1875730538556288:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836512.099325:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45b7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+19:20260:x1875730538556288:12345-0@lo:502:mount.lustre.0 Request processed in 268us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836512.099334:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788836512.099423:0:20260:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bcf45b32d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788836512.099449:0:20260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538556288:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788836512.099526:0:20260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:1.0:1788836512.099536:0:20260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788836512.104270:0:20269:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788836512.104293:0:20269:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9bd07b234d28) 00000020:00000080:1.0:1788836512.104322:0:20269:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1788836512.104456:0:20269:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd07a3ae800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788836512.104466:0:20269:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd07a3ae800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788836512.104469:0:20269:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd07a3ae800 3 00010000:00080000:1.0:1788836512.104511:0:20269:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd047f4e800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.152@tcp at head 00010000:00010000:2.0:1788836512.113492:0:20269:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1788836512.114927:0:20269:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788836512.114983:0:20269:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788836512.116383:0:20269:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcb5b7bc40b90acdd 00000100:00080000:2.0:1788836512.116402:0:20269:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788836512.116410:0:20269:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bd047f4e800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788836512.116459:0:20269:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd07a3de680 x1875730538556416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788836512.116502:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1875730538556416:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788836512.116587:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836512.117222:0:18855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538556416 00000100:00100000:2.0:1788836512.117234:0:18855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538556416 00000100:00100000:2.0:1788836512.117296:0:18855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788836512.117305:0:18855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1875730538556416:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788836512.117366:0:18855:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 565 last 0 00000020:00000080:2.0:1788836512.117411:0:18855:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcb5b7bc40b90ace4 00000004:00100000:2.0:1788836512.117431:0:18855:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788836512.117470:0:18855:0:(import.c:65:import_set_state_nolock()) ffff9bcf47711000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788836512.117538:0:18855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875730538556416:12345-0@lo:38:llog_process_th.0 Request processed in 232us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836512.117546:0:18855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788836512.117591:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd07a3de680 x1875730538556416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788836522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836512.119710:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788836512.119736:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1788836512.119751:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788836512.119757:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788836512.119761:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd047f4e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788836512.119774:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1875730538556416:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788836512.119851:0:20269:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788836512.119946:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836512.119951:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788836512.119954:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd07af71000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788836512.119959:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 562 00000100:00080000:2.0:1788836512.119964:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788836512.119969:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bd07af71000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788836512.119994:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd07a3df100 x1875730538556672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788836512.120049:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538556672:0@lo:8:kworker.0 00000100:00100000:2.0:1788836512.120129:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836512.120171:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538556800:0@lo:400:kworker.0 00000100:00100000:2.0:1788836512.120200:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836512.120219:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788836512.120225:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538556928:0@lo:400:kworker.0 00000100:00100000:2.0:1788836512.120259:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836512.120294:0:19539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538556672 00000100:00100000:2.0:1788836512.120311:0:19539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538556672 00000100:00100000:2.0:1788836512.120371:0:19539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788836512.120379:0:19539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1875730538556672:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788836512.120440:0:19539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1875730538556672:12345-0@lo:8:kworker.0 Request processed in 60us (311us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788836512.120448:0:19539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788836512.120473:0:20076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538556800 00000100:00100000:2.0:1788836512.120476:0:20076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538556800 00000100:00100000:2.0:1788836512.120503:0:20076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538556928 00000100:00100000:2.0:1788836512.120505:0:20076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538556928 00000100:00100000:2.0:1788836512.120534:0:20076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788836512.120540:0:20076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538556800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836512.120583:0:20076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538556800:12345-0@lo:400:kworker.0 Request processed in 44us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836512.120590:0:20076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788836512.120602:0:20076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788836512.121097:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538556544:0@lo:400:kworker.0 00000100:00100000:3.0:1788836512.121142:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788836512.121185:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836512.121201:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538556544 00000100:00100000:3.0:1788836512.121205:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538556544 00000100:00100000:3.0:1788836512.121253:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788836512.121260:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1875730538556544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836512.121299:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1875730538556544:12345-0@lo:400:kworker.0 Request processed in 39us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836512.121305:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788836512.121321:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836512.121374:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538556544:0@lo:400:kworker.0 00000100:00100000:2.0:1788836512.122387:0:20076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538556928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836512.122462:0:20076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538556928:12345-0@lo:400:kworker.0 Request processed in 1853us (2200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836512.122471:0:20076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788836512.122527:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788836512.122536:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd07af71000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788836512.122541:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788836512.122545:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538556672:0@lo:8:kworker.0 00010000:00080000:2.0:1788836512.122602:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd07a3ddf80 x1875730538556928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836512.123982:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538556928:0@lo:400:kworker.0 00010000:00080000:2.0:1788836512.124094:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd07a3dc380 x1875730538556800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836512.124105:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538556800:0@lo:400:kworker.0 00000040:00080000:1.0:1788836512.140067:0:20269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:1.0:1788836512.140160:0:20260:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788836512.140191:0:20260:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788836512.140217:0:20260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd060377a00/0xcb5b7bc40b90acc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90accf expref: -99 pid: 20260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836512.140230:0:20260:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd060377a00/0xcb5b7bc40b90acc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90accf expref: -99 pid: 20260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788836512.140297:0:20260:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788836512.140299:0:20260:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788836512.140300:0:20260:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788836512.140302:0:20260:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788836512.140303:0:20260:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788836512.140305:0:20260:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788836512.140306:0:20260:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788836512.140308:0:20260:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788836512.140310:0:20260:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788836512.140316:0:20260:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788836512.140319:0:20260:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788836512.140320:0:20260:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788836512.140321:0:20260:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788836512.140322:0:20260:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788836512.140324:0:20260:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788836512.140325:0:20260:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788836512.140326:0:20260:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788836512.140327:0:20260:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788836512.140328:0:20260:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788836512.140390:0:20260:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788836512.140418:0:20260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538557056:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788836512.140513:0:20260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836512.142090:0:20260:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bcf45b32cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836512.142136:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538557056 00000100:00100000:1.0:1788836512.142147:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538557056 00000100:00100000:1.0:1788836512.142211:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788836512.142222:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45b7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+19:20260:x1875730538557056:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788836512.142274:0:18850:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788836512.142292:0:18850:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788836512.207899:0:18850:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788836512.207923:0:18850:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788836512.208242:0:18871:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788836512.208248:0:18871:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788836512.208278:0:18871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90aceb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836512.208301:0:18871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd08217c600/0xcb5b7bc40b90aba2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90ab9b expref: 19 pid: 18849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836512.208311:0:18871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90aceb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836512.208403:0:18871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd08217c600/0xcb5b7bc40b90aba2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b90ab9b expref: 19 pid: 18849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836512.208419:0:18871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd08217c600/0xcb5b7bc40b90aba2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b90ab9b expref: 19 pid: 18849 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836512.208436:0:18871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad03100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18871:1875730538557184:0@lo:104: 00000100:00100000:3.0:1788836512.208538:0:18871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836512.208592:0:18871:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047a8b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788836512.208773:0:18838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538557184 00000100:00100000:1.0:1788836512.208783:0:18838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538557184 00000100:00100000:1.0:1788836512.208840:0:18838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788836512.208852:0:18838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cc96480a-9861-42d8-abb0-6f65502ae376+3:18871:x1875730538557184:12345-0@lo:104: 00010000:00010000:1.0:1788836512.208868:0:18838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd040030800/0xcb5b7bc40b90ab9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90aba2 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836512.208937:0:18838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788836512.208944:0:18838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cc96480a-9861-42d8-abb0-6f65502ae376+3:18871:x1875730538557184:12345-0@lo:104: Request processed in 95us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836512.208951:0:18838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788836512.209065:0:18871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad03100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18871:1875730538557184:0@lo:104: 00010000:00010000:1.0:1788836512.209092:0:18871:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90aceb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836512.209113:0:18843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836512.209119:0:18843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd040030800/0xcb5b7bc40b90ab9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90aba2 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836512.209127:0:18843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040030800 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:1.0:1788836512.209131:0:18843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd040030800/0xcb5b7bc40b90ab9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b90aba2 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836512.209761:0:18843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd040030800/0xcb5b7bc40b90ab9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b90aba2 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836512.209769:0:18843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd040030800/0xcb5b7bc40b90ab9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b90aba2 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836512.209775:0:18843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788836512.209820:0:18843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd040030800/0xcb5b7bc40b90ab9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90aba2 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836512.209827:0:18843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788836512.209857:0:18843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd040030800/0xcb5b7bc40b90ab9b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90aba2 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836512.209864:0:18843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd040030800/0xcb5b7bc40b90ab9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90aba2 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836512.209886:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836512.209888:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836512.209890:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836512.209912:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788836512.209927:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc96480a-9861-42d8-abb0-6f65502ae376:3303:1875730538557312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788836512.209975:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836512.210024:0:18842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538557312 00000100:00100000:1.0:1788836512.210030:0:18842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538557312 00010000:00010000:1.0:1788836512.210057:0:18842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd08217c600/0xcb5b7bc40b90aba2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90ab9b expref: 20 pid: 18849 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836512.210086:0:18842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788836512.210105:0:18842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc96480a-9861-42d8-abb0-6f65502ae376+20:3303:x1875730538557312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788836512.210119:0:18842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836512.210125:0:18842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd08217c600/0xcb5b7bc40b90aba2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90ab9b expref: 20 pid: 18849 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836512.210137:0:18842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd08217c600/0xcb5b7bc40b90aba2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b90ab9b expref: 20 pid: 18849 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836512.210164:0:18842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd08217c600/0xcb5b7bc40b90aba2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b90ab9b expref: 20 pid: 18849 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836512.210178:0:18842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90aceb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836512.210188:0:18842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90aceb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788836512.210205:0:18842:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001957041s 00010000:00010000:1.0:1788836512.210209:0:18842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90aceb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836512.210215:0:18842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90aceb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836512.210223:0:18842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90aceb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836512.210242:0:18842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90aceb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836512.210248:0:18842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040030400 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836512.210259:0:18842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90aceb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836512.210267:0:18842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90aceb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836512.210281:0:18842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90aceb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836512.210291:0:18842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836512.210325:0:18842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc96480a-9861-42d8-abb0-6f65502ae376+19:3303:x1875730538557312:12345-0@lo:103:ldlm_bl.0 Request processed in 222us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836512.210333:0:18842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788836512.210384:0:18871:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90aceb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836512.210392:0:18871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90aceb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836512.210399:0:18871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90aceb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836512.210432:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc96480a-9861-42d8-abb0-6f65502ae376:3303:1875730538557312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788836512.223531:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45b7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+18:20260:x1875730538557056:12345-0@lo:253:mount.lustre.0 Request processed in 81295us (83002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836512.223549:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788836512.225891:0:20260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc96480a-9861-42d8-abb0-6f65502ae376:20260:1875730538557056:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788836512.225917:0:20260:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788836512.225922:0:20260:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788836512.225924:0:20260:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788836512.225925:0:20260:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788836512.225926:0:20260:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788836512.225928:0:20260:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788836512.225929:0:20260:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788836512.225964:0:20260:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788836512.225966:0:20260:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788836512.225968:0:20260:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788836512.226056:0:20260:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788836512.230439:0:20260:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788836512.230881:0:20260:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788836512.231308:0:20260:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788836512.231576:0:20260:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788836512.231904:0:20260:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788836512.232215:0:20260:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788836512.234946:0:20260:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1788836512.293884:0:20260:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788836512.293899:0:20260:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788836512.293939:0:20260:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788836512.294025:0:20260:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788836512.294042:0:20260:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788836512.294084:0:20260:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788836512.656869:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836513.684652:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788836513.749108:0:18853:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788836513.749118:0:18853:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bcf46073800 from 11 10000000:01000000:1.0:1788836513.749124:0:18853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788836513.749186:0:18853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd060376c00/0xcb5b7bc40b90acf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836513.749200:0:18853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd060376c00/0xcb5b7bc40b90acf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836513.749215:0:18853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd060376c00/0xcb5b7bc40b90acf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836513.749257:0:18853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538557440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788836513.749364:0:18853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836513.749419:0:18853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd043c63000 going to sleep for 11 seconds 00000100:00100000:3.0:1788836513.749486:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538557440 00000100:00100000:3.0:1788836513.749496:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538557440 00000100:00100000:3.0:1788836513.749550:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788836513.749562:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45b7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+18:18853:x1875730538557440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836513.749579:0:18849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836513.749597:0:18849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90acf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90acf2 expref: -99 pid: 18849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836513.749629:0:18849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90acf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90acf2 expref: 19 pid: 18849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836513.749710:0:18849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b90acf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90acf2 expref: 19 pid: 18849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836513.749721:0:18849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040030400, rc 0) 00000100:00100000:3.0:1788836513.749770:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45b7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+19:18853:x1875730538557440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 211us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836513.749777:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788836513.752594:0:18853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538557440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836513.752635:0:18853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd060376c00/0xcb5b7bc40b90acf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90acf9 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836513.752653:0:18853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd060376c00/0xcb5b7bc40b90acf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90acf9 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836513.752743:0:18853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538557568:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788836513.752825:0:18853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836513.752886:0:18853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd043c63000 going to sleep for 11 seconds 00000100:00100000:3.0:1788836513.752962:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538557568 00000100:00100000:3.0:1788836513.752971:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538557568 00000100:00100000:3.0:1788836513.753033:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788836513.753043:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45b7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+19:18853:x1875730538557568:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788836513.753069:0:18850:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788836513.753087:0:18850:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788836513.753091:0:18850:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1788836513.753180:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45b7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+19:18853:x1875730538557568:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 138us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836513.753193:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788836513.753276:0:18853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538557568:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788836513.753727:0:18853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788836513.753738:0:18853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd060376c00/0xcb5b7bc40b90acf2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90acf9 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836513.753749:0:18853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd060376c00/0xcb5b7bc40b90acf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90acf9 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788836513.756471:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:3.0:1788836513.756553:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788836514.648663:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836514.648688:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538557696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836514.648759:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836514.652213:0:19543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538557696 00000100:00100000:3.0:1788836514.652239:0:19543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538557696 00000100:00100000:3.0:1788836514.652316:0:19543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836514.652327:0:19543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538557696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788836514.652383:0:19543:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788836514.652473:0:19543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538557696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (3714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836514.652481:0:19543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788836514.652637:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836514.652698:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788836514.652721:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538557696:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788836514.705357:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836515.730221:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788836516.305144:0:18889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788836516.754285:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788836517.200511:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788836517.200518:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788836517.200522:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd07af71000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788836517.200535:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bd07af71000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788836517.200557:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd07a358a80 x1875730538558080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788836517.200618:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538557952:0@lo:400:kworker.0 00000100:00100000:0.0:1788836517.200681:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836517.200746:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788836517.200752:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a35b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc96480a-9861-42d8-abb0-6f65502ae376:3305:1875730538557824:0@lo:400:kworker.0 00000100:00100000:0.0:1788836517.200779:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836517.200803:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a35a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875730538558464:0@lo:400:kworker.0 00000100:00100000:0.0:1788836517.200831:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836517.200854:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538558080:0@lo:8:kworker.0 00000100:00100000:0.0:1788836517.200877:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836517.200902:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a35ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875730538558336:0@lo:400:kworker.0 00000100:00100000:0.0:1788836517.200929:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836517.200944:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788836517.200949:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875730538558208:0@lo:400:kworker.0 00000100:00100000:0.0:1788836517.200970:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836517.200999:0:19539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538557952 00000100:00100000:0.0:1788836517.201007:0:19539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538557952 00000100:00100000:3.0:1788836517.201244:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538558464 00000100:00100000:3.0:1788836517.201248:0:18856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538558464 00000100:00100000:3.0:1788836517.201278:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538558336 00000100:00100000:3.0:1788836517.201281:0:18856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538558336 00000100:00100000:3.0:1788836517.201293:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538558208 00000100:00100000:3.0:1788836517.201295:0:18856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538558208 00000100:00100000:3.0:1788836517.201307:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788836517.201315:0:18856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a35b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875730538558464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836517.201388:0:18856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a35b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875730538558464:12345-0@lo:400:kworker.0 Request processed in 72us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836517.201408:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788836517.201424:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788836517.201431:0:18856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875730538558336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836517.201479:0:18856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875730538558336:12345-0@lo:400:kworker.0 Request processed in 49us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836517.201485:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788836517.201497:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788836517.201503:0:18856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875730538558208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836517.201529:0:18856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875730538558208:12345-0@lo:400:kworker.0 Request processed in 26us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836517.201534:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788836517.201550:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538558080 00000100:00100000:3.0:1788836517.201553:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538558080 00000100:00100000:3.0:1788836517.201571:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836517.201577:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538557952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836517.201606:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538557952:12345-0@lo:400:kworker.0 Request processed in 29us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836517.201612:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836517.201625:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788836517.201629:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a35b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3301:x1875730538558080:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788836517.201652:0:19542:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 570 last 0 00000020:00000080:3.0:1788836517.201681:0:19542:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcb5b7bc40b90ad00 00002000:00100000:3.0:1788836517.201695:0:19542:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9bcf4771d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396b ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788836517.201699:0:19542:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788836517.201707:0:19542:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788836517.202035:0:19542:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788836517.202074:0:19542:0:(import.c:65:import_set_state_nolock()) ffff9bcf4771f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788836517.202116:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a35b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1875730538558080:12345-0@lo:8:kworker.0 Request processed in 485us (1237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836517.202123:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788836517.202534:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538557824 00000100:00100000:1.0:1788836517.202541:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538557824 00000100:00100000:1.0:1788836517.202576:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788836517.202584:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45b7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+19:3305:x1875730538557824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836517.202623:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45b7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+19:3305:x1875730538557824:12345-0@lo:400:kworker.0 Request processed in 40us (1842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836517.202629:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:3.0:1788836517.203360:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07a358a80 x1875730538558080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788836542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788836517.203376:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788836517.203384:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788836517.203390:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788836517.203393:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd07af71000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788836517.205371:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788836517.205388:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538558080:0@lo:8:kworker.0 00010000:00080000:3.0:1788836517.205501:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07a359500 x1875730538558208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836517.205516:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875730538558208:0@lo:400:kworker.0 00010000:00080000:3.0:1788836517.205531:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07a35ad80 x1875730538558336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836517.205540:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a35ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875730538558336:0@lo:400:kworker.0 00000100:00100000:3.0:1788836517.205570:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a35b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc96480a-9861-42d8-abb0-6f65502ae376:3305:1875730538557824:0@lo:400:kworker.0 00010000:00080000:3.0:1788836517.205592:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07a35a300 x1875730538558464/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836517.205601:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a35a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875730538558464:0@lo:400:kworker.0 00000100:00100000:3.0:1788836517.205628:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538557952:0@lo:400:kworker.0 00000004:00080000:0.0:1788836517.206166:0:18879:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788836517.206626:0:18879:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 570341282371ns, next at 0ns, rc = 0 00000100:00080000:0.0:1788836517.206651:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788836517.206657:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788836517.214410:0:18880:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x22:0x0] 00000100:00100000:1.0:1788836517.214440:0:18880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acca680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18880:1875730538558720:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788836517.214503:0:18880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836517.214533:0:18880:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd048669e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788836517.214549:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788836517.214561:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538558592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788836517.214588:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836517.214623:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538558720 00000100:00100000:1.0:1788836517.214630:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538558720 00000100:00100000:1.0:1788836517.214689:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788836517.214698:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:18880:x1875730538558720:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788836517.219029:0:19542:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788836517.219041:0:19542:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:1.0:1788836517.219046:0:19542:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:35 to 0x280000400:65) 00000100:00100000:3.0:1788836517.224470:0:19543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538558592 00000100:00100000:3.0:1788836517.224484:0:19543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538558592 00000100:00100000:3.0:1788836517.224553:0:19543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788836517.224565:0:19543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07accb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875730538558592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788836517.224605:0:19543:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788836517.224708:0:19543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07accb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875730538558592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (10119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836517.224716:0:19543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788836517.237166:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07acc9500 x1875730538558592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836533 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836517.237194:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538558592:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788836517.237234:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1788836517.240049:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836517.240061:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e36ef4be/0xcb5b7bc40b90ad07 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.240078:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788836517.240082:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836517.240088:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e36ef4be/0xcb5b7bc40b90ad07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.240106:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e36ef4be/0xcb5b7bc40b90ad07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.240117:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e36ef4be/0xcb5b7bc40b90ad07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.240124:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e36ef4be/0xcb5b7bc40b90ad07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.240142:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788836517.240657:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836517.240664:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000663cf281/0xcb5b7bc40b90ad0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.240678:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788836517.240682:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836517.240686:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000663cf281/0xcb5b7bc40b90ad0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.240696:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000663cf281/0xcb5b7bc40b90ad0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.240704:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000663cf281/0xcb5b7bc40b90ad0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.240711:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000663cf281/0xcb5b7bc40b90ad0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.240726:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788836517.240737:0:20131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788836517.240743:0:20131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e36ef4be/0xcb5b7bc40b90ad07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.240751:0:20131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060377600 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836517.240755:0:20131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e36ef4be/0xcb5b7bc40b90ad07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.240774:0:20131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e36ef4be/0xcb5b7bc40b90ad07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.240790:0:20131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e36ef4be/0xcb5b7bc40b90ad07 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.240797:0:20131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e36ef4be/0xcb5b7bc40b90ad07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.240810:0:20131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836517.240813:0:20131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000663cf281/0xcb5b7bc40b90ad0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.240819:0:20131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376600 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836517.240821:0:20131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000663cf281/0xcb5b7bc40b90ad0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.240827:0:20131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000663cf281/0xcb5b7bc40b90ad0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.240835:0:20131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000663cf281/0xcb5b7bc40b90ad0e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.240841:0:20131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000663cf281/0xcb5b7bc40b90ad0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.240863:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836517.240865:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836517.240867:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836517.242886:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836517.242898:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b16aeb04/0xcb5b7bc40b90ad15 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.242925:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788836517.242929:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836517.242936:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b16aeb04/0xcb5b7bc40b90ad15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.242948:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b16aeb04/0xcb5b7bc40b90ad15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.244382:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b16aeb04/0xcb5b7bc40b90ad15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.244395:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b16aeb04/0xcb5b7bc40b90ad15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.244416:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836517.244593:0:18843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836517.244600:0:18843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b16aeb04/0xcb5b7bc40b90ad15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.244609:0:18843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060377800 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836517.244614:0:18843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b16aeb04/0xcb5b7bc40b90ad15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.244624:0:18843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b16aeb04/0xcb5b7bc40b90ad15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.244646:0:18843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b16aeb04/0xcb5b7bc40b90ad15 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.244665:0:18843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b16aeb04/0xcb5b7bc40b90ad15 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.246065:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836517.246068:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836517.246071:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836517.247130:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836517.249315:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836517.249327:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8f77d77/0xcb5b7bc40b90ad1c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.249373:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788836517.249379:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836517.249386:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8f77d77/0xcb5b7bc40b90ad1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.249401:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8f77d77/0xcb5b7bc40b90ad1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.249412:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8f77d77/0xcb5b7bc40b90ad1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.249420:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8f77d77/0xcb5b7bc40b90ad1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.249439:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836517.249602:0:20131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836517.249611:0:20131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8f77d77/0xcb5b7bc40b90ad1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.249622:0:20131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060377400 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836517.249627:0:20131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8f77d77/0xcb5b7bc40b90ad1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.249638:0:20131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8f77d77/0xcb5b7bc40b90ad1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.249658:0:20131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8f77d77/0xcb5b7bc40b90ad1c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.249666:0:20131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8f77d77/0xcb5b7bc40b90ad1c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.249691:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836517.249694:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836517.249696:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836517.249901:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836517.249921:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ebbb027/0xcb5b7bc40b90ad23 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.249932:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788836517.249935:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836517.249940:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ebbb027/0xcb5b7bc40b90ad23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.249950:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ebbb027/0xcb5b7bc40b90ad23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.249975:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ebbb027/0xcb5b7bc40b90ad23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.249982:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ebbb027/0xcb5b7bc40b90ad23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.250001:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836517.250078:0:18843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836517.250085:0:18843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ebbb027/0xcb5b7bc40b90ad23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.250093:0:18843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376800 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836517.250097:0:18843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ebbb027/0xcb5b7bc40b90ad23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.250106:0:18843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ebbb027/0xcb5b7bc40b90ad23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.250120:0:18843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ebbb027/0xcb5b7bc40b90ad23 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.250128:0:18843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ebbb027/0xcb5b7bc40b90ad23 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.250146:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836517.250149:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836517.250152:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836517.250441:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836517.250448:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bccac31a/0xcb5b7bc40b90ad2a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.250456:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788836517.250460:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836517.250464:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bccac31a/0xcb5b7bc40b90ad2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.250473:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bccac31a/0xcb5b7bc40b90ad2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.250480:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bccac31a/0xcb5b7bc40b90ad2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.250487:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bccac31a/0xcb5b7bc40b90ad2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.250518:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836517.250538:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836517.250546:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bccac31a/0xcb5b7bc40b90ad2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.250554:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376400 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836517.250557:0:18844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bccac31a/0xcb5b7bc40b90ad2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.250565:0:18844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bccac31a/0xcb5b7bc40b90ad2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.250582:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bccac31a/0xcb5b7bc40b90ad2a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.250589:0:18844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bccac31a/0xcb5b7bc40b90ad2a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.250632:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836517.250635:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836517.250639:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836517.250945:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836517.250951:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d11227f/0xcb5b7bc40b90ad31 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.250960:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788836517.250963:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836517.250967:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d11227f/0xcb5b7bc40b90ad31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.250977:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d11227f/0xcb5b7bc40b90ad31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.250985:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d11227f/0xcb5b7bc40b90ad31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.250992:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d11227f/0xcb5b7bc40b90ad31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.251012:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836517.251131:0:20131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836517.251138:0:20131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d11227f/0xcb5b7bc40b90ad31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.251146:0:20131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376e00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836517.251151:0:20131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d11227f/0xcb5b7bc40b90ad31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.251172:0:20131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d11227f/0xcb5b7bc40b90ad31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.251186:0:20131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d11227f/0xcb5b7bc40b90ad31 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.251194:0:20131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d11227f/0xcb5b7bc40b90ad31 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.251220:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836517.251223:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836517.251225:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836517.251442:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836517.251449:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c26d7f90/0xcb5b7bc40b90ad38 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.251458:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788836517.251467:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836517.251472:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c26d7f90/0xcb5b7bc40b90ad38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.251483:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c26d7f90/0xcb5b7bc40b90ad38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.251491:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c26d7f90/0xcb5b7bc40b90ad38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.251499:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c26d7f90/0xcb5b7bc40b90ad38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.251519:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788836517.251899:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836517.251905:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c7e5c31/0xcb5b7bc40b90ad3f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.251913:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788836517.251916:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836517.251920:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c7e5c31/0xcb5b7bc40b90ad3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.251930:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c7e5c31/0xcb5b7bc40b90ad3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.251937:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c7e5c31/0xcb5b7bc40b90ad3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.251950:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c7e5c31/0xcb5b7bc40b90ad3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.251971:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788836517.252004:0:18843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788836517.252011:0:18843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c26d7f90/0xcb5b7bc40b90ad38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.252020:0:18843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060377c00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836517.252025:0:18843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c26d7f90/0xcb5b7bc40b90ad38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.252033:0:18843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c26d7f90/0xcb5b7bc40b90ad38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.252049:0:18843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c26d7f90/0xcb5b7bc40b90ad38 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.252142:0:18843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c26d7f90/0xcb5b7bc40b90ad38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.252163:0:18843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836517.252167:0:18843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c7e5c31/0xcb5b7bc40b90ad3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.252175:0:18843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bcf463a5a00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836517.252178:0:18843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c7e5c31/0xcb5b7bc40b90ad3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.252186:0:18843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c7e5c31/0xcb5b7bc40b90ad3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.252199:0:18843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c7e5c31/0xcb5b7bc40b90ad3f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.252219:0:18843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c7e5c31/0xcb5b7bc40b90ad3f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.252232:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836517.252234:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836517.252236:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836517.252279:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836517.256176:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836517.256193:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089ea3c4f/0xcb5b7bc40b90ad46 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.256220:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788836517.256225:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836517.256231:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089ea3c4f/0xcb5b7bc40b90ad46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.256246:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089ea3c4f/0xcb5b7bc40b90ad46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.256258:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089ea3c4f/0xcb5b7bc40b90ad46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.256266:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089ea3c4f/0xcb5b7bc40b90ad46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.256296:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788836517.257288:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836517.257295:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096c6ef03/0xcb5b7bc40b90ad4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.257311:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788836517.257315:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836517.257320:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096c6ef03/0xcb5b7bc40b90ad4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.257330:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096c6ef03/0xcb5b7bc40b90ad4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.257338:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096c6ef03/0xcb5b7bc40b90ad4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.257365:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096c6ef03/0xcb5b7bc40b90ad4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.257382:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788836517.257793:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836517.257799:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a1aef4c/0xcb5b7bc40b90ad54 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.257808:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788836517.257811:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836517.257815:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a1aef4c/0xcb5b7bc40b90ad54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.257824:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a1aef4c/0xcb5b7bc40b90ad54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.257845:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a1aef4c/0xcb5b7bc40b90ad54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.257851:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a1aef4c/0xcb5b7bc40b90ad54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.257866:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788836517.257877:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788836517.257883:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089ea3c4f/0xcb5b7bc40b90ad46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.257891:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bcf463a4800 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836517.257896:0:18844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089ea3c4f/0xcb5b7bc40b90ad46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.257903:0:18844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089ea3c4f/0xcb5b7bc40b90ad46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.258317:0:18843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788836517.258325:0:18843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096c6ef03/0xcb5b7bc40b90ad4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.258336:0:18843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bcf463a5400 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836517.258340:0:18843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096c6ef03/0xcb5b7bc40b90ad4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.258361:0:18843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096c6ef03/0xcb5b7bc40b90ad4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.258381:0:18843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096c6ef03/0xcb5b7bc40b90ad4d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.258390:0:18843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096c6ef03/0xcb5b7bc40b90ad4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.258416:0:18843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836517.258420:0:18843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a1aef4c/0xcb5b7bc40b90ad54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.258426:0:18843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bcf463a4a00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836517.258436:0:18843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a1aef4c/0xcb5b7bc40b90ad54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.258602:0:18843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a1aef4c/0xcb5b7bc40b90ad54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.258614:0:18843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a1aef4c/0xcb5b7bc40b90ad54 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.258620:0:18843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a1aef4c/0xcb5b7bc40b90ad54 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.258634:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836517.258635:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836517.258637:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836517.259104:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788836517.261287:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1788836517.261916:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089ea3c4f/0xcb5b7bc40b90ad46 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.261927:0:18844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089ea3c4f/0xcb5b7bc40b90ad46 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.261951:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836517.262147:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836517.262149:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836517.262755:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836517.262762:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f31ccae/0xcb5b7bc40b90ad5b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.262775:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788836517.262779:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836517.262785:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f31ccae/0xcb5b7bc40b90ad5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.262799:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f31ccae/0xcb5b7bc40b90ad5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.262808:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f31ccae/0xcb5b7bc40b90ad5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.262815:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f31ccae/0xcb5b7bc40b90ad5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.262836:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836517.262937:0:18843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836517.262944:0:18843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f31ccae/0xcb5b7bc40b90ad5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.262954:0:18843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bcf463a5600 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836517.262958:0:18843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f31ccae/0xcb5b7bc40b90ad5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.262968:0:18843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f31ccae/0xcb5b7bc40b90ad5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.262982:0:18843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f31ccae/0xcb5b7bc40b90ad5b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.262997:0:18843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f31ccae/0xcb5b7bc40b90ad5b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.263012:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836517.263013:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836517.263015:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836517.264576:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836517.264584:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000629aafa3/0xcb5b7bc40b90ad62 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.264595:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788836517.264597:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836517.264601:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000629aafa3/0xcb5b7bc40b90ad62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.264711:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000629aafa3/0xcb5b7bc40b90ad62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.264782:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000629aafa3/0xcb5b7bc40b90ad62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.264792:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000629aafa3/0xcb5b7bc40b90ad62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.264814:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836517.265009:0:20131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836517.265016:0:20131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000629aafa3/0xcb5b7bc40b90ad62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.265027:0:20131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bcf463a4c00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836517.265032:0:20131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000629aafa3/0xcb5b7bc40b90ad62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.265042:0:20131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000629aafa3/0xcb5b7bc40b90ad62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.265128:0:20131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000629aafa3/0xcb5b7bc40b90ad62 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.265138:0:20131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000629aafa3/0xcb5b7bc40b90ad62 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.265168:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836517.265171:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836517.265175:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836517.265412:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836517.265418:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090b7733e/0xcb5b7bc40b90ad69 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.265427:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788836517.265430:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836517.265434:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090b7733e/0xcb5b7bc40b90ad69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.265443:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090b7733e/0xcb5b7bc40b90ad69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.265451:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090b7733e/0xcb5b7bc40b90ad69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.265470:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090b7733e/0xcb5b7bc40b90ad69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.265488:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836517.265515:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836517.265522:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090b7733e/0xcb5b7bc40b90ad69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.265531:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bcf463a4600 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836517.265536:0:18844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090b7733e/0xcb5b7bc40b90ad69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.265544:0:18844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090b7733e/0xcb5b7bc40b90ad69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.265559:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090b7733e/0xcb5b7bc40b90ad69 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.265566:0:18844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090b7733e/0xcb5b7bc40b90ad69 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.265590:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836517.265594:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836517.265597:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836517.266227:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836517.266234:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000413adb6a/0xcb5b7bc40b90ad70 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.266242:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788836517.266245:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836517.266250:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000413adb6a/0xcb5b7bc40b90ad70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.266260:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000413adb6a/0xcb5b7bc40b90ad70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.266268:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000413adb6a/0xcb5b7bc40b90ad70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.266275:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000413adb6a/0xcb5b7bc40b90ad70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.266287:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836517.266547:0:18843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836517.266554:0:18843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000413adb6a/0xcb5b7bc40b90ad70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.266563:0:18843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bcf463a4e00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836517.266567:0:18843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000413adb6a/0xcb5b7bc40b90ad70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.266588:0:18843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000413adb6a/0xcb5b7bc40b90ad70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.266603:0:18843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000413adb6a/0xcb5b7bc40b90ad70 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.266610:0:18843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000413adb6a/0xcb5b7bc40b90ad70 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.266627:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836517.266629:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836517.266631:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836517.266905:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836517.266911:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a4f66dd/0xcb5b7bc40b90ad77 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.266926:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788836517.266929:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836517.266933:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a4f66dd/0xcb5b7bc40b90ad77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.266943:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a4f66dd/0xcb5b7bc40b90ad77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.266951:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a4f66dd/0xcb5b7bc40b90ad77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.266959:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a4f66dd/0xcb5b7bc40b90ad77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.266979:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836517.267045:0:20131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836517.267051:0:20131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a4f66dd/0xcb5b7bc40b90ad77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.267066:0:20131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bcf463a4400 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836517.267069:0:20131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a4f66dd/0xcb5b7bc40b90ad77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.267077:0:20131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a4f66dd/0xcb5b7bc40b90ad77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.267088:0:20131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a4f66dd/0xcb5b7bc40b90ad77 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.267096:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836517.267098:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836517.267100:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836517.267168:0:19542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a4f66dd/0xcb5b7bc40b90ad77 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788836517.267847:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836517.267855:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1be7fd9/0xcb5b7bc40b90ad7e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.267864:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788836517.267868:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836517.267872:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1be7fd9/0xcb5b7bc40b90ad7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.267895:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1be7fd9/0xcb5b7bc40b90ad7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.267904:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1be7fd9/0xcb5b7bc40b90ad7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.267911:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1be7fd9/0xcb5b7bc40b90ad7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.267932:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836517.267958:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836517.267964:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1be7fd9/0xcb5b7bc40b90ad7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.267972:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bcf463a5c00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836517.267976:0:18844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1be7fd9/0xcb5b7bc40b90ad7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.268215:0:18844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1be7fd9/0xcb5b7bc40b90ad7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.268230:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1be7fd9/0xcb5b7bc40b90ad7e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.268248:0:18844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1be7fd9/0xcb5b7bc40b90ad7e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836517.268264:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836517.268266:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836517.268268:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836517.268961:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836517.268968:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005413d0ad/0xcb5b7bc40b90ad85 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.268978:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788836517.269044:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836517.269169:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005413d0ad/0xcb5b7bc40b90ad85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.269181:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005413d0ad/0xcb5b7bc40b90ad85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.269190:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005413d0ad/0xcb5b7bc40b90ad85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.269220:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005413d0ad/0xcb5b7bc40b90ad85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.269242:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836517.269261:0:18843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836517.269268:0:18843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005413d0ad/0xcb5b7bc40b90ad85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.269276:0:18843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bcf463a4000 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836517.269279:0:18843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005413d0ad/0xcb5b7bc40b90ad85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.269288:0:18843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005413d0ad/0xcb5b7bc40b90ad85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.269301:0:18843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005413d0ad/0xcb5b7bc40b90ad85 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.269314:0:18843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005413d0ad/0xcb5b7bc40b90ad85 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.269330:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836517.269332:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836517.269334:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836517.270181:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836517.270190:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036d7445f/0xcb5b7bc40b90ad8c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.270208:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788836517.270211:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836517.270216:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036d7445f/0xcb5b7bc40b90ad8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.270227:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036d7445f/0xcb5b7bc40b90ad8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.270237:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036d7445f/0xcb5b7bc40b90ad8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.270244:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036d7445f/0xcb5b7bc40b90ad8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.270263:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836517.270283:0:20131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836517.270289:0:20131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036d7445f/0xcb5b7bc40b90ad8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.270297:0:20131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bcf463a5e00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836517.270300:0:20131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036d7445f/0xcb5b7bc40b90ad8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.270309:0:20131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036d7445f/0xcb5b7bc40b90ad8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.270321:0:20131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036d7445f/0xcb5b7bc40b90ad8c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.270329:0:20131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036d7445f/0xcb5b7bc40b90ad8c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.270359:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836517.270362:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836517.270363:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836517.270704:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836517.270710:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c50ee55/0xcb5b7bc40b90ad93 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.270734:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788836517.270737:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836517.270742:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c50ee55/0xcb5b7bc40b90ad93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.270752:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c50ee55/0xcb5b7bc40b90ad93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.270760:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c50ee55/0xcb5b7bc40b90ad93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.270768:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c50ee55/0xcb5b7bc40b90ad93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.270789:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836517.270805:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836517.270811:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c50ee55/0xcb5b7bc40b90ad93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.270819:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bcf463a5200 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836517.270823:0:18844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c50ee55/0xcb5b7bc40b90ad93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.270831:0:18844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c50ee55/0xcb5b7bc40b90ad93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.270843:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c50ee55/0xcb5b7bc40b90ad93 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.270851:0:18844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c50ee55/0xcb5b7bc40b90ad93 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.270863:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836517.270865:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836517.270866:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836517.271925:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836517.271934:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b10ddc0/0xcb5b7bc40b90ad9a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.271945:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788836517.271949:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836517.271954:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b10ddc0/0xcb5b7bc40b90ad9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.271965:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b10ddc0/0xcb5b7bc40b90ad9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.272039:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b10ddc0/0xcb5b7bc40b90ad9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.272162:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b10ddc0/0xcb5b7bc40b90ad9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.272184:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836517.272209:0:18843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836517.272216:0:18843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b10ddc0/0xcb5b7bc40b90ad9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.272225:0:18843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bcf463a4200 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836517.272229:0:18843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b10ddc0/0xcb5b7bc40b90ad9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.272247:0:18843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b10ddc0/0xcb5b7bc40b90ad9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.272262:0:18843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b10ddc0/0xcb5b7bc40b90ad9a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.272269:0:18843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b10ddc0/0xcb5b7bc40b90ad9a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.272286:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836517.272288:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836517.272290:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836517.272878:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836517.272884:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4cc47b9/0xcb5b7bc40b90ada1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.272893:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788836517.272896:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836517.272900:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4cc47b9/0xcb5b7bc40b90ada1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.272910:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4cc47b9/0xcb5b7bc40b90ada1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.272919:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4cc47b9/0xcb5b7bc40b90ada1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.272926:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4cc47b9/0xcb5b7bc40b90ada1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.272955:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836517.272987:0:20131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836517.272992:0:20131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4cc47b9/0xcb5b7bc40b90ada1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.273000:0:20131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bcf463a5000 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836517.273003:0:20131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4cc47b9/0xcb5b7bc40b90ada1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.273011:0:20131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4cc47b9/0xcb5b7bc40b90ada1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.273022:0:20131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4cc47b9/0xcb5b7bc40b90ada1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.273041:0:20131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4cc47b9/0xcb5b7bc40b90ada1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.273058:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836517.273060:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836517.273062:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836517.273794:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836517.273801:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001de725ee/0xcb5b7bc40b90ada8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.273810:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788836517.273813:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836517.273818:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001de725ee/0xcb5b7bc40b90ada8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.273827:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001de725ee/0xcb5b7bc40b90ada8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.273835:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001de725ee/0xcb5b7bc40b90ada8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.273843:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001de725ee/0xcb5b7bc40b90ada8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.273861:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836517.273880:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836517.273886:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001de725ee/0xcb5b7bc40b90ada8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.273894:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bcf463a5800 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836517.273897:0:18844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001de725ee/0xcb5b7bc40b90ada8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.273915:0:18844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001de725ee/0xcb5b7bc40b90ada8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.273929:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001de725ee/0xcb5b7bc40b90ada8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.273936:0:18844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001de725ee/0xcb5b7bc40b90ada8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.273949:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836517.273951:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836517.273953:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836517.274414:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836517.274420:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000663cf281/0xcb5b7bc40b90adaf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.274429:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788836517.274437:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836517.274442:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000663cf281/0xcb5b7bc40b90adaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.274452:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000663cf281/0xcb5b7bc40b90adaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.274459:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000663cf281/0xcb5b7bc40b90adaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.274466:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000663cf281/0xcb5b7bc40b90adaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.274485:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836517.274505:0:18843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836517.274510:0:18843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000663cf281/0xcb5b7bc40b90adaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.274518:0:18843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376600 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836517.274521:0:18843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000663cf281/0xcb5b7bc40b90adaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.274529:0:18843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000663cf281/0xcb5b7bc40b90adaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.274541:0:18843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000663cf281/0xcb5b7bc40b90adaf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.274549:0:18843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000663cf281/0xcb5b7bc40b90adaf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.274564:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836517.274566:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836517.274567:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836517.275706:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836517.275715:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e36ef4be/0xcb5b7bc40b90adb6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.275790:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788836517.275794:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836517.275799:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e36ef4be/0xcb5b7bc40b90adb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.275812:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e36ef4be/0xcb5b7bc40b90adb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.275822:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e36ef4be/0xcb5b7bc40b90adb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.275836:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e36ef4be/0xcb5b7bc40b90adb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.275855:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836517.275873:0:20131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836517.275879:0:20131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e36ef4be/0xcb5b7bc40b90adb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.275887:0:20131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060377600 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836517.275891:0:20131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e36ef4be/0xcb5b7bc40b90adb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.275910:0:20131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e36ef4be/0xcb5b7bc40b90adb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.275935:0:20131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e36ef4be/0xcb5b7bc40b90adb6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.275942:0:20131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e36ef4be/0xcb5b7bc40b90adb6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836517.276077:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836517.276080:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836517.276081:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836517.276474:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836517.276480:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d9cdf88/0xcb5b7bc40b90adbd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.276489:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788836517.276565:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836517.276570:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d9cdf88/0xcb5b7bc40b90adbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.276580:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d9cdf88/0xcb5b7bc40b90adbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.276589:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d9cdf88/0xcb5b7bc40b90adbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.276596:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d9cdf88/0xcb5b7bc40b90adbd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.276613:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836517.276621:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836517.276626:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d9cdf88/0xcb5b7bc40b90adbd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.276696:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bcf44ab4000 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836517.276699:0:18844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d9cdf88/0xcb5b7bc40b90adbd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.276707:0:18844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d9cdf88/0xcb5b7bc40b90adbd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.276719:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d9cdf88/0xcb5b7bc40b90adbd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.276780:0:18844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d9cdf88/0xcb5b7bc40b90adbd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.276795:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836517.276797:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836517.276799:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836517.277375:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836517.277381:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b91bbd1/0xcb5b7bc40b90adc4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.277390:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788836517.277393:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836517.277397:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b91bbd1/0xcb5b7bc40b90adc4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.277407:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b91bbd1/0xcb5b7bc40b90adc4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.277420:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b91bbd1/0xcb5b7bc40b90adc4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.277428:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b91bbd1/0xcb5b7bc40b90adc4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.277440:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788836517.278042:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836517.278055:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4aafe75/0xcb5b7bc40b90adcb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.278152:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788836517.278155:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836517.278160:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4aafe75/0xcb5b7bc40b90adcb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.278170:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4aafe75/0xcb5b7bc40b90adcb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.278178:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4aafe75/0xcb5b7bc40b90adcb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.278186:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4aafe75/0xcb5b7bc40b90adcb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.278224:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788836517.278235:0:20131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788836517.278239:0:20131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b91bbd1/0xcb5b7bc40b90adc4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.278246:0:20131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bcf44ab5e00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836517.278250:0:20131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b91bbd1/0xcb5b7bc40b90adc4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.278258:0:20131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b91bbd1/0xcb5b7bc40b90adc4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.278270:0:20131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b91bbd1/0xcb5b7bc40b90adc4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.278277:0:20131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b91bbd1/0xcb5b7bc40b90adc4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.278291:0:20131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836517.278294:0:20131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4aafe75/0xcb5b7bc40b90adcb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.278300:0:20131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bcf44ab5200 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836517.278304:0:20131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4aafe75/0xcb5b7bc40b90adcb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.278321:0:20131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4aafe75/0xcb5b7bc40b90adcb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.278331:0:20131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4aafe75/0xcb5b7bc40b90adcb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.278337:0:20131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4aafe75/0xcb5b7bc40b90adcb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.278368:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836517.278369:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836517.278371:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836517.278882:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836517.278889:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067b437db/0xcb5b7bc40b90add2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.278898:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788836517.278901:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836517.278905:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067b437db/0xcb5b7bc40b90add2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.278914:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067b437db/0xcb5b7bc40b90add2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.278922:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067b437db/0xcb5b7bc40b90add2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.278933:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067b437db/0xcb5b7bc40b90add2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.278947:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836517.278956:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836517.278960:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067b437db/0xcb5b7bc40b90add2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.278966:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bcf44ab4200 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836517.278969:0:18844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067b437db/0xcb5b7bc40b90add2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.278977:0:18844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067b437db/0xcb5b7bc40b90add2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.279180:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067b437db/0xcb5b7bc40b90add2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.279188:0:18844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067b437db/0xcb5b7bc40b90add2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.279209:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836517.279211:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836517.279213:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788836517.279793:0:19542:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788836517.279805:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db2c6c84/0xcb5b7bc40b90add9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.279815:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=570s v=(0 0) 00010000:00010000:1.0:1788836517.279818:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836517.279822:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db2c6c84/0xcb5b7bc40b90add9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.279831:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db2c6c84/0xcb5b7bc40b90add9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.279839:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db2c6c84/0xcb5b7bc40b90add9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.279846:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db2c6c84/0xcb5b7bc40b90add9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.279859:0:19542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836517.279867:0:20131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836517.279871:0:20131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db2c6c84/0xcb5b7bc40b90add9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.279877:0:20131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bcf44ab5000 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836517.279881:0:20131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db2c6c84/0xcb5b7bc40b90add9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.279889:0:20131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db2c6c84/0xcb5b7bc40b90add9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.279904:0:20131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db2c6c84/0xcb5b7bc40b90add9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.279912:0:20131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db2c6c84/0xcb5b7bc40b90add9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836517.279925:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836517.279927:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836517.279928:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788836517.280455:0:19542:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:34 00010000:00010000:2.0:1788836517.280562:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836517.280698:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:18880:x1875730538558720:12345-0@lo:5:osp-pre-1-0.0 Request processed in 65933us (66126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836517.280710:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788836517.280729:0:18880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acca680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18880:1875730538558720:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788836517.280746:0:18880:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x22:0x0] 00000100:00100000:2.0:1788836517.280794:0:18880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dc380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18880:1875730538558848:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788836517.280832:0:18880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836517.280871:0:18880:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0507390c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836517.280948:0:20128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538558848 00000100:00100000:3.0:1788836517.280954:0:20128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538558848 00000100:00100000:3.0:1788836517.281047:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788836517.281056:0:20128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:18880:x1875730538558848:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788836517.281091:0:20128:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:3.0:1788836517.284391:0:20128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:18880:x1875730538558848:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3329us (3551us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788836517.284402:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788836517.284422:0:18880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dc380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18880:1875730538558848:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788836517.284436:0:18880:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00010000:00010000:1.0:1788836517.777523:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788836517.785831:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:0.0:1788836517.785843:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:02000400:0.0:1788836518.444441:0:20618:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788836518.802146:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836519.761293:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788836519.761316:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538558976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836519.761408:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836519.761475:0:19543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538558976 00000100:00100000:2.0:1788836519.761482:0:19543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538558976 00000100:00100000:2.0:1788836519.761541:0:19543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788836519.761550:0:19543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538558976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788836519.761592:0:19543:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788836519.761634:0:19543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538558976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836519.761641:0:19543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788836519.761689:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538558976:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788836519.761821:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788836519.829528:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836520.523291:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836520.523659:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518640896 00000100:00100000:1.0:1788836520.523669:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518640896 00000100:00100000:1.0:1788836520.523718:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:1.0:1788836520.523726:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45b7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2352:x1875730518640896:12345-192.168.203.52@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788836520.523753:0:18849:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 462ae43d-104f-4dae-9208-57a489fa1d04@192.168.203.52@tcp t0 exp 0000000000000000 cur 573 last 0 00000020:00000080:1.0:1788836520.523783:0:18849:0:(genops.c:1385:class_connect()) connect: client 462ae43d-104f-4dae-9208-57a489fa1d04, cookie 0xcb5b7bc40b90ade0 00000100:00080000:1.0:1788836520.523913:0:18849:0:(import.c:65:import_set_state_nolock()) ffff9bcf45ecc000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788836520.523981:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45b7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:462ae43d-104f-4dae-9208-57a489fa1d04+5:2352:x1875730518640896:12345-192.168.203.52@tcp:250:mount.lustre.0 Request processed in 253us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836520.524005:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:2.0:1788836520.535115:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836520.535220:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518641024 00000100:00100000:3.0:1788836520.535230:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518641024 00000100:00100000:3.0:1788836520.535324:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:3.0:1788836520.535335:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45b7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:462ae43d-104f-4dae-9208-57a489fa1d04+5:16754:x1875730518641024:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788836520.535384:0:18850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836520.535404:0:18850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd0413d2800/0xcb5b7bc40b90ade7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb59b48549316ac52 expref: -99 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836520.535433:0:18850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd0413d2800/0xcb5b7bc40b90ade7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac52 expref: 6 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836520.535465:0:18850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd0413d2800/0xcb5b7bc40b90ade7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac52 expref: 6 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836520.535475:0:18850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0413d2800, rc 0) 00000100:00100000:3.0:1788836520.535536:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45b7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:462ae43d-104f-4dae-9208-57a489fa1d04+6:16754:x1875730518641024:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 202us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836520.535543:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:0.0:1788836520.541114:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836520.541246:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518641152 00000100:00100000:2.0:1788836520.541256:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518641152 00000100:00100000:2.0:1788836520.541401:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 76 00000100:00100000:2.0:1788836520.541412:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45b7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:462ae43d-104f-4dae-9208-57a489fa1d04+6:16754:x1875730518641152:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788836520.541741:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45b7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:462ae43d-104f-4dae-9208-57a489fa1d04+6:16754:x1875730518641152:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 330us (635us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788836520.541751:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 76 00000100:00100000:0.0:1788836520.543817:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836520.543909:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518641280 00000100:00100000:3.0:1788836520.543919:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518641280 00000100:00100000:3.0:1788836520.543982:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:3.0:1788836520.543991:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45b7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:462ae43d-104f-4dae-9208-57a489fa1d04+6:16754:x1875730518641280:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788836520.544008:0:18850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836520.544027:0:18850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd0413d2600/0xcb5b7bc40b90adee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb59b48549316ac59 expref: -99 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836520.544066:0:18850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd0413d2600/0xcb5b7bc40b90adee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac59 expref: 7 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836520.544078:0:18850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd0413d2600/0xcb5b7bc40b90adee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac59 expref: 7 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836520.544087:0:18850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0413d2600, rc 0) 00000100:00100000:3.0:1788836520.544141:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45b7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:462ae43d-104f-4dae-9208-57a489fa1d04+7:16754:x1875730518641280:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 151us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836520.544147:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:3.0:1788836520.547188:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836520.547730:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518641408 00000100:00100000:2.0:1788836520.547740:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518641408 00000100:00100000:2.0:1788836520.547798:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:2.0:1788836520.547808:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45b7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:462ae43d-104f-4dae-9208-57a489fa1d04+7:16754:x1875730518641408:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788836520.555396:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45b7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:462ae43d-104f-4dae-9208-57a489fa1d04+8:16754:x1875730518641408:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 7577us (8215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836520.555412:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:0.0:1788836520.566692:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836520.566802:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518641536 00000100:00100000:1.0:1788836520.566814:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518641536 00000100:00100000:1.0:1788836520.566874:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 79 00000100:00100000:1.0:1788836520.566886:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45b7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:462ae43d-104f-4dae-9208-57a489fa1d04+8:16754:x1875730518641536:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788836520.570822:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45b7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:462ae43d-104f-4dae-9208-57a489fa1d04+8:16754:x1875730518641536:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 3927us (4129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836520.570837:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 79 00000100:00100000:0.0:1788836520.579846:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836520.579983:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518641664 00000100:00100000:2.0:1788836520.579994:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518641664 00000100:00100000:2.0:1788836520.580046:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:2.0:1788836520.580057:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45b7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:462ae43d-104f-4dae-9208-57a489fa1d04+8:16773:x1875730518641664:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788836520.580449:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45b7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:462ae43d-104f-4dae-9208-57a489fa1d04+8:16773:x1875730518641664:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 392us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836520.580465:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:2.0:1788836520.607043:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836520.612825:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518641792 00000100:00100000:1.0:1788836520.612840:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518641792 00000100:00100000:1.0:1788836520.613250:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00100000:2.0:1788836520.613373:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4502f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:462ae43d-104f-4dae-9208-57a489fa1d04+8:16773:x1875730518641792:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788836520.613661:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4502f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:462ae43d-104f-4dae-9208-57a489fa1d04+8:16773:x1875730518641792:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 400us (6743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836520.618310:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00100000:0.0:1788836520.620758:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836520.621274:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518641920 00000100:00100000:2.0:1788836520.621284:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518641920 00000100:00100000:2.0:1788836520.621373:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 82 00000100:00100000:2.0:1788836520.621385:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4502e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:462ae43d-104f-4dae-9208-57a489fa1d04+8:16754:x1875730518641920:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788836520.621403:0:18847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836520.621421:0:18847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd07efb3000/0xcb5b7bc40b90adf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb59b48549316ac83 expref: -99 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836520.621449:0:18847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd07efb3000/0xcb5b7bc40b90adf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac83 expref: 9 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836520.621462:0:18847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd07efb3000/0xcb5b7bc40b90adf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac83 expref: 9 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836520.621482:0:18847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07efb3000, rc 0) 00000100:00100000:2.0:1788836520.621537:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4502e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:462ae43d-104f-4dae-9208-57a489fa1d04+9:16754:x1875730518641920:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 154us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836520.621544:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 82 00000100:00100000:0.0:1788836520.627311:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836520.627420:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518642048 00000100:00100000:3.0:1788836520.627430:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518642048 00000100:00100000:3.0:1788836520.627489:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 83 00000100:00100000:3.0:1788836520.627500:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4502c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:462ae43d-104f-4dae-9208-57a489fa1d04+9:16754:x1875730518642048:12345-192.168.203.52@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788836520.627525:0:18850:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788836520.627549:0:18850:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788836520.627553:0:18850:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788836520.627556:0:18850:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788836520.627558:0:18850:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:3.0:1788836520.634886:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4502c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:462ae43d-104f-4dae-9208-57a489fa1d04+9:16754:x1875730518642048:12345-192.168.203.52@tcp:256:mount.lustre.0 Request processed in 7368us (7565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836520.634900:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 83 00000100:00100000:0.0:1788836520.641463:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836520.641548:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518642176 00000100:00100000:3.0:1788836520.641559:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518642176 00000100:00100000:3.0:1788836520.641619:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 84 00000100:00100000:3.0:1788836520.641629:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4502cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:462ae43d-104f-4dae-9208-57a489fa1d04+9:16754:x1875730518642176:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788836520.641646:0:18849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836520.641663:0:18849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd0413d3600/0xcb5b7bc40b90adfc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb59b48549316ac8a expref: -99 pid: 18849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836520.641693:0:18849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd0413d3600/0xcb5b7bc40b90adfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac8a expref: 10 pid: 18849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836520.641707:0:18849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd0413d3600/0xcb5b7bc40b90adfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac8a expref: 10 pid: 18849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836520.641718:0:18849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0413d3600, rc 0) 00000100:00100000:3.0:1788836520.641781:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4502cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:462ae43d-104f-4dae-9208-57a489fa1d04+10:16754:x1875730518642176:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 153us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836520.641802:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 84 00000100:00100000:0.0:1788836520.646442:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836520.646628:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518642304 00000100:00100000:3.0:1788836520.646639:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518642304 00000100:00100000:3.0:1788836520.646694:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00100000:3.0:1788836520.646705:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4502f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:462ae43d-104f-4dae-9208-57a489fa1d04+10:16754:x1875730518642304:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788836520.647144:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4502f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:462ae43d-104f-4dae-9208-57a489fa1d04+10:16754:x1875730518642304:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 439us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836520.647152:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00100000:0.0:1788836520.650197:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836520.650288:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518642432 00000100:00100000:3.0:1788836520.650299:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518642432 00000100:00100000:3.0:1788836520.650385:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 86 00000100:00100000:3.0:1788836520.650394:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4502e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:462ae43d-104f-4dae-9208-57a489fa1d04+10:16754:x1875730518642432:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788836520.651256:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4502e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:462ae43d-104f-4dae-9208-57a489fa1d04+10:16754:x1875730518642432:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 860us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836520.651266:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 86 00000100:00100000:0.0:1788836520.656151:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836520.656904:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518642560 00000100:00100000:3.0:1788836520.656915:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518642560 00000100:00100000:3.0:1788836520.657098:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 87 00000100:00100000:3.0:1788836520.657109:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4502d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:462ae43d-104f-4dae-9208-57a489fa1d04+10:16778:x1875730518642560:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788836520.657423:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4502d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:462ae43d-104f-4dae-9208-57a489fa1d04+10:16778:x1875730518642560:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 316us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836520.657432:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 87 00000100:00100000:0.0:1788836520.660577:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836520.660739:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518642688 00000100:00100000:3.0:1788836520.660749:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518642688 00000100:00100000:3.0:1788836520.660813:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 88 00000100:00100000:3.0:1788836520.660822:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4502dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:462ae43d-104f-4dae-9208-57a489fa1d04+10:16778:x1875730518642688:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788836520.661080:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4502dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:462ae43d-104f-4dae-9208-57a489fa1d04+10:16778:x1875730518642688:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 258us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836520.661088:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 88 00000100:00100000:0.0:1788836520.673866:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836520.674662:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518642816 00000100:00100000:3.0:1788836520.674674:0:18856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518642816 00000100:00100000:3.0:1788836520.674729:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:3.0:1788836520.674737:0:18856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2352:x1875730518642816:12345-192.168.203.52@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788836520.674765:0:18856:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 9f148df4-92ed-4188-b862-bd6c7c089260@192.168.203.52@tcp t0 exp 0000000000000000 cur 573 last 0 00000020:00000080:3.0:1788836520.674819:0:18856:0:(genops.c:1385:class_connect()) connect: client 9f148df4-92ed-4188-b862-bd6c7c089260, cookie 0xcb5b7bc40b90ae03 00000004:00100000:3.0:1788836520.674852:0:18856:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788836520.674858:0:18856:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:2.0:1788836520.737094:0:18856:0:(import.c:65:import_set_state_nolock()) ffff9bcf47710800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788836520.737176:0:18856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f148df4-92ed-4188-b862-bd6c7c089260+6:2352:x1875730518642816:12345-192.168.203.52@tcp:38:mount.lustre.0 Request processed in 62436us (63319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836520.737202:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:0.0:1788836520.742804:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836520.742883:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836520.751395:0:18855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518643072 00000100:00100000:3.0:1788836520.751411:0:18855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518643072 00000100:00080000:0.0:1788836520.753132:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836520.753642:0:18855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518642944 00000100:00100000:3.0:1788836520.753653:0:18855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518642944 00000100:00100000:2.0:1788836520.753660:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:2.0:1788836520.753672:0:18857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f148df4-92ed-4188-b862-bd6c7c089260+7:16754:x1875730518643072:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788836520.753716:0:18857:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788836520.753810:0:18857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f148df4-92ed-4188-b862-bd6c7c089260+7:16754:x1875730518643072:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 139us (11016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836520.753818:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:2.0:1788836520.753837:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:2.0:1788836520.753844:0:18857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a35a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f148df4-92ed-4188-b862-bd6c7c089260+6:0:x1875730518642944:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788836520.753855:0:18857:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788836520.753892:0:18857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a35a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f148df4-92ed-4188-b862-bd6c7c089260+6:0:x1875730518642944:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 48us (11009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836520.753898:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:0.0:1788836520.763593:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836520.763787:0:20076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518643200 00000100:00100000:1.0:1788836520.763797:0:20076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518643200 00000100:00100000:1.0:1788836520.763855:0:20076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:1.0:1788836520.763865:0:20076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a35b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f148df4-92ed-4188-b862-bd6c7c089260+6:16754:x1875730518643200:12345-192.168.203.52@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788836520.764571:0:20076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a35b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f148df4-92ed-4188-b862-bd6c7c089260+6:16754:x1875730518643200:12345-192.168.203.52@tcp:40:mount.lustre.0 Request processed in 706us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836520.764580:0:20076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:2.0:1788836520.776678:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836520.776779:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836520.776986:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836520.777331:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518643584 00000100:00100000:0.0:1788836520.777360:0:18858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518643584 00000100:00100000:0.0:1788836520.777416:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:0.0:1788836520.777425:0:18858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9f148df4-92ed-4188-b862-bd6c7c089260+6:16754:x1875730518643584:12345-192.168.203.52@tcp:33:mount.lustre.0 00000100:00100000:1.0:1788836520.777852:0:19541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518643328 00000100:00100000:1.0:1788836520.777857:0:19541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518643328 00000100:00100000:1.0:1788836520.777976:0:19541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518643456 00000100:00100000:1.0:1788836520.777981:0:19541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518643456 00000100:00100000:3.0:1788836520.778027:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:3.0:1788836520.778044:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1875730518643328:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788836520.778072:0:19542:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 9f148df4-92ed-4188-b862-bd6c7c089260@192.168.203.52@tcp t0 exp 0000000000000000 cur 573 last 0 00000020:00000080:3.0:1788836520.778106:0:19542:0:(genops.c:1385:class_connect()) connect: client 9f148df4-92ed-4188-b862-bd6c7c089260, cookie 0xcb5b7bc40b90ae0a 00002000:00100000:3.0:1788836520.778119:0:19542:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9f148df4-92ed-4188-b862-bd6c7c089260/ffff9bcf4771a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788836520.778130:0:19542:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788836520.778475:0:19542:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788836520.778505:0:19542:0:(import.c:65:import_set_state_nolock()) ffff9bcf4771c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788836520.778596:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9f148df4-92ed-4188-b862-bd6c7c089260+6:2352:x1875730518643328:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 561us (1927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836520.778605:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:3.0:1788836520.778622:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:3.0:1788836520.778627:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1875730518643456:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788836520.778642:0:19542:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9f148df4-92ed-4188-b862-bd6c7c089260@192.168.203.52@tcp t0 exp 0000000000000000 cur 573 last 0 00000020:00000080:3.0:1788836520.778662:0:19542:0:(genops.c:1385:class_connect()) connect: client 9f148df4-92ed-4188-b862-bd6c7c089260, cookie 0xcb5b7bc40b90ae11 00002000:00100000:3.0:1788836520.778668:0:19542:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9f148df4-92ed-4188-b862-bd6c7c089260/ffff9bcf47718000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788836520.778683:0:19542:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788836520.779821:0:19542:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788836520.779848:0:19542:0:(import.c:65:import_set_state_nolock()) ffff9bcf4771e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788836520.780141:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9f148df4-92ed-4188-b862-bd6c7c089260+6:2352:x1875730518643456:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 1511us (3361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836520.780148:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000004:00080000:0.0:1788836520.783587:0:18858:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 6093us 00000004:00200000:0.0:1788836520.799607:0:18858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788836520.799734:0:18858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9f148df4-92ed-4188-b862-bd6c7c089260+6:16754:x1875730518643584:12345-192.168.203.52@tcp:33:mount.lustre.0 Request processed in 22304us (22743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836520.799746:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00010000:00010000:1.0:1788836520.849012:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836521.011588:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836521.011741:0:18855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518643712 00000100:00100000:3.0:1788836521.011752:0:18855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518643712 00000100:00100000:3.0:1788836521.011810:0:18855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:3.0:1788836521.011820:0:18855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a35ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f148df4-92ed-4188-b862-bd6c7c089260+6:16799:x1875730518643712:12345-192.168.203.52@tcp:101:mkdir.0 00010000:00010000:3.0:1788836521.011840:0:18855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836521.011862:0:18855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2000/0xcb5b7bc40b90ae18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316acb4 expref: -99 pid: 18855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836521.011940:0:18855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2a00/0xcb5b7bc40b90ae1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836521.011955:0:18855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2a00/0xcb5b7bc40b90ae1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836521.011985:0:18855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2a00/0xcb5b7bc40b90ae1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836521.012025:0:18855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788836521.012029:0:18855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788836521.012063:0:18855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2a00/0xcb5b7bc40b90ae1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836521.012089:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2000/0xcb5b7bc40b90ae18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316acb4 expref: 8 pid: 18855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836521.012110:0:18855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2a00/0xcb5b7bc40b90ae1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316acb4 expref: 7 pid: 18855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836521.012118:0:18855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04506a800) 00010000:00010000:3.0:1788836521.012121:0:18855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788836521.012124:0:18855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0413d2a00, rc 0) 00000100:00100000:3.0:1788836521.012208:0:18855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a35ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f148df4-92ed-4188-b862-bd6c7c089260+7:16799:x1875730518643712:12345-192.168.203.52@tcp:101:mkdir.0 Request processed in 389us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836521.012215:0:18855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00010000:00010000:3.0:1788836521.872794:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836522.320741:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538559488:0@lo:400:kworker.0 00000100:00100000:3.0:1788836522.320813:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836522.320903:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788836522.320910:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc96480a-9861-42d8-abb0-6f65502ae376:3302:1875730538559104:0@lo:400:kworker.0 00000100:00100000:3.0:1788836522.320941:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836522.320967:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538559616:0@lo:400:kworker.0 00000100:00100000:3.0:1788836522.321004:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836522.321028:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538559360:0@lo:400:kworker.0 00000100:00100000:3.0:1788836522.321049:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836522.321064:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788836522.321069:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538559232:0@lo:400:kworker.0 00000100:00100000:3.0:1788836522.321086:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836522.321101:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875730538559744:0@lo:400:kworker.0 00000100:00100000:3.0:1788836522.321117:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836522.321143:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538559104 00000100:00100000:3.0:1788836522.321149:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538559104 00000100:00100000:3.0:1788836522.321200:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788836522.321210:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4502f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+19:3302:x1875730538559104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836522.321255:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4502f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+19:3302:x1875730538559104:12345-0@lo:400:kworker.0 Request processed in 47us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836522.321261:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788836522.321309:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc96480a-9861-42d8-abb0-6f65502ae376:3302:1875730538559104:0@lo:400:kworker.0 00000100:00100000:3.0:1788836522.321333:0:18855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538559488 00000100:00100000:3.0:1788836522.321336:0:18855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538559488 00000100:00100000:3.0:1788836522.321386:0:18855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538559616 00000100:00100000:3.0:1788836522.321389:0:18855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538559616 00000100:00100000:3.0:1788836522.321409:0:18855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538559744 00000100:00100000:3.0:1788836522.321411:0:18855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538559744 00000100:00100000:3.0:1788836522.321426:0:18855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788836522.321433:0:18855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538559488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836522.321469:0:18855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538559488:12345-0@lo:400:kworker.0 Request processed in 37us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836522.321498:0:18855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788836522.321513:0:18855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788836522.321519:0:18855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538559616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836522.321549:0:18855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538559616:12345-0@lo:400:kworker.0 Request processed in 31us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836522.321555:0:18855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788836522.321567:0:18855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788836522.321573:0:18855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875730538559744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836522.321604:0:18855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875730538559744:12345-0@lo:400:kworker.0 Request processed in 31us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836522.321609:0:18855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788836522.321634:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875730538559744:0@lo:400:kworker.0 00000100:00100000:3.0:1788836522.321655:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538559616:0@lo:400:kworker.0 00000100:00100000:3.0:1788836522.321664:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538559488:0@lo:400:kworker.0 00000100:00100000:3.0:1788836522.321683:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538559360 00000100:00100000:3.0:1788836522.321686:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538559360 00000100:00100000:3.0:1788836522.321710:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538559232 00000100:00100000:3.0:1788836522.321713:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538559232 00000100:00100000:3.0:1788836522.321733:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788836522.321739:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538559360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836522.321774:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538559360:12345-0@lo:400:kworker.0 Request processed in 35us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836522.321781:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788836522.321801:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788836522.321821:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538559360:0@lo:400:kworker.0 00000100:00100000:3.0:1788836522.321839:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788836522.321845:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538559232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836522.321879:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538559232:12345-0@lo:400:kworker.0 Request processed in 34us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836522.321885:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788836522.321908:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538559232:0@lo:400:kworker.0 00000100:00080000:0.0:1788836522.322224:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788836522.322229:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788836522.322231:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836522.324401:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538559872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836522.324477:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836522.324690:0:19543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538559872 00000100:00100000:3.0:1788836522.324699:0:19543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538559872 00000100:00100000:3.0:1788836522.324911:0:19543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788836522.324932:0:19543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538559872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788836522.324966:0:19543:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788836522.325021:0:19543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538559872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836522.325092:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538559872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836522.325589:0:19543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788836522.896758:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788836522.916434:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9f148df4-92ed-4188-b862-bd6c7c089260 00000100:00100000:3.0:1788836522.963579:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836522.963680:0:18855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518643840 00000100:00100000:0.0:1788836522.963690:0:18855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518643840 00000100:00100000:0.0:1788836522.963761:0:18855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:0.0:1788836522.963770:0:18855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f148df4-92ed-4188-b862-bd6c7c089260+7:16851:x1875730518643840:12345-192.168.203.52@tcp:41:lfs.0 00000004:00000024:0.0:1788836522.963811:0:18855:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788836522.963895:0:18855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f148df4-92ed-4188-b862-bd6c7c089260+7:16851:x1875730518643840:12345-192.168.203.52@tcp:41:lfs.0 Request processed in 126us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836522.963901:0:18855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00080000:2.0:1788836522.964472:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836522.967324:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836522.967456:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518643968 00000100:00100000:2.0:1788836522.967465:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518643968 00000100:00100000:2.0:1788836522.967534:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:2.0:1788836522.967545:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9f148df4-92ed-4188-b862-bd6c7c089260+6:16851:x1875730518643968:12345-192.168.203.52@tcp:13:lfs.0 00002000:00000024:2.0:1788836522.967582:0:19544:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788836522.967669:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9f148df4-92ed-4188-b862-bd6c7c089260+6:16851:x1875730518643968:12345-192.168.203.52@tcp:13:lfs.0 Request processed in 126us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836522.967689:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00080000:0.0:1788836522.968535:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836522.969745:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836522.970867:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518644096 00000100:00100000:2.0:1788836522.970879:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518644096 00000100:00100000:2.0:1788836522.970961:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:2.0:1788836522.970970:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9f148df4-92ed-4188-b862-bd6c7c089260+5:16851:x1875730518644096:12345-192.168.203.52@tcp:13:lfs.0 00002000:00000024:2.0:1788836522.970993:0:19544:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788836522.971084:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9f148df4-92ed-4188-b862-bd6c7c089260+5:16851:x1875730518644096:12345-192.168.203.52@tcp:13:lfs.0 Request processed in 115us (1345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836522.971092:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00080000:0.0:1788836522.971621:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788836523.192935:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836523.193060:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518644224 00000100:00100000:1.0:1788836523.193069:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518644224 00000100:00100000:1.0:1788836523.193127:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 90 00000100:00100000:1.0:1788836523.193154:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4502d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:462ae43d-104f-4dae-9208-57a489fa1d04+10:16882:x1875730518644224:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788836523.193179:0:18847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836523.193199:0:18847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bcf44ab5a00/0xcb5b7bc40b90ae26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb59b48549316acbb expref: -99 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836523.193232:0:18847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bcf44ab5a00/0xcb5b7bc40b90ae26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316acbb expref: 11 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836523.193245:0:18847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bcf44ab5a00/0xcb5b7bc40b90ae26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316acbb expref: 11 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836523.193254:0:18847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bcf44ab5a00, rc 0) 00000100:00100000:1.0:1788836523.193326:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4502d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:462ae43d-104f-4dae-9208-57a489fa1d04+11:16882:x1875730518644224:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 175us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836523.193333:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 90 00000100:00100000:3.0:1788836523.201306:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836523.201455:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518644352 00000100:00100000:0.0:1788836523.201467:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518644352 00000100:00100000:0.0:1788836523.201529:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 91 00000100:00100000:0.0:1788836523.201539:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4502e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:462ae43d-104f-4dae-9208-57a489fa1d04+11:16882:x1875730518644352:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788836523.201864:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4502e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:462ae43d-104f-4dae-9208-57a489fa1d04+11:16882:x1875730518644352:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 324us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836523.201880:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 91 00000100:00100000:3.0:1788836523.208446:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836523.209403:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518644480 00000100:00100000:1.0:1788836523.209417:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518644480 00000100:00100000:1.0:1788836523.209483:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 92 00000100:00100000:1.0:1788836523.209493:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4502c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:462ae43d-104f-4dae-9208-57a489fa1d04+11:16882:x1875730518644480:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788836523.209732:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4502c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:462ae43d-104f-4dae-9208-57a489fa1d04+11:16882:x1875730518644480:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 240us (1293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836523.209741:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 92 00000100:00100000:2.0:1788836523.226742:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836523.226984:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518644608 00000100:00100000:3.0:1788836523.226995:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518644608 00000100:00100000:3.0:1788836523.227065:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 93 00000100:00100000:3.0:1788836523.227075:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4502c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:462ae43d-104f-4dae-9208-57a489fa1d04+11:16890:x1875730518644608:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788836523.227403:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4502c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:462ae43d-104f-4dae-9208-57a489fa1d04+11:16890:x1875730518644608:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 329us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836523.227417:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 93 00000100:00100000:3.0:1788836523.269237:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836523.269389:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518644736 00000100:00100000:0.0:1788836523.269401:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518644736 00000100:00100000:0.0:1788836523.269466:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 94 00000100:00100000:0.0:1788836523.269476:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4502d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:462ae43d-104f-4dae-9208-57a489fa1d04+11:16890:x1875730518644736:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788836523.269773:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4502d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:462ae43d-104f-4dae-9208-57a489fa1d04+11:16890:x1875730518644736:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 296us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836523.269781:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 94 00000100:00100000:0.0:1788836523.272713:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836523.273012:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518644864 00000100:00100000:1.0:1788836523.273035:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518644864 00000100:00100000:1.0:1788836523.273085:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 95 00000100:00100000:1.0:1788836523.273093:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4502fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:462ae43d-104f-4dae-9208-57a489fa1d04+11:16882:x1875730518644864:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788836523.273111:0:18847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836523.273138:0:18847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bcf44ab4800/0xcb5b7bc40b90ae2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb59b48549316ace5 expref: -99 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836523.273173:0:18847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bcf44ab4800/0xcb5b7bc40b90ae2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ace5 expref: 12 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836523.273185:0:18847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bcf44ab4800/0xcb5b7bc40b90ae2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ace5 expref: 12 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836523.273193:0:18847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bcf44ab4800, rc 0) 00000100:00100000:1.0:1788836523.273654:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4502fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:462ae43d-104f-4dae-9208-57a489fa1d04+12:16882:x1875730518644864:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 558us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836523.273661:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 95 00000100:00100000:3.0:1788836523.278300:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836523.278386:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518644992 00000100:00100000:0.0:1788836523.278397:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518644992 00000100:00100000:0.0:1788836523.278470:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 96 00000100:00100000:0.0:1788836523.278480:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4502ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:462ae43d-104f-4dae-9208-57a489fa1d04+12:16882:x1875730518644992:12345-192.168.203.52@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788836523.278507:0:18850:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788836523.278534:0:18850:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788836523.278537:0:18850:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788836523.278541:0:18850:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788836523.278543:0:18850:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:0.0:1788836523.298750:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4502ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:462ae43d-104f-4dae-9208-57a489fa1d04+12:16882:x1875730518644992:12345-192.168.203.52@tcp:256:mount.lustre.0 Request processed in 20260us (20448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836523.298765:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 96 00000100:00100000:2.0:1788836523.307612:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836523.307733:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518645120 00000100:00100000:1.0:1788836523.307743:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518645120 00000100:00100000:1.0:1788836523.307812:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 97 00000100:00100000:1.0:1788836523.307823:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd048098c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:462ae43d-104f-4dae-9208-57a489fa1d04+12:16882:x1875730518645120:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788836523.307839:0:18847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836523.307867:0:18847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bcf44ab4a00/0xcb5b7bc40b90ae34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb59b48549316acec expref: -99 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836523.307896:0:18847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bcf44ab4a00/0xcb5b7bc40b90ae34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316acec expref: 13 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836523.307907:0:18847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bcf44ab4a00/0xcb5b7bc40b90ae34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316acec expref: 13 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836523.307916:0:18847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bcf44ab4a00, rc 0) 00000100:00100000:1.0:1788836523.307983:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd048098c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:462ae43d-104f-4dae-9208-57a489fa1d04+13:16882:x1875730518645120:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 161us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836523.308002:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 97 00000100:00100000:1.0:1788836523.317563:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836523.317664:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518645248 00000100:00100000:0.0:1788836523.317674:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518645248 00000100:00100000:0.0:1788836523.317732:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 98 00000100:00100000:0.0:1788836523.317743:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd048098850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:462ae43d-104f-4dae-9208-57a489fa1d04+13:16882:x1875730518645248:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788836523.318107:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd048098850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:462ae43d-104f-4dae-9208-57a489fa1d04+13:16882:x1875730518645248:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 365us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836523.318116:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 98 00000100:00100000:3.0:1788836523.327423:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836523.327520:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518645376 00000100:00100000:0.0:1788836523.327529:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518645376 00000100:00100000:0.0:1788836523.327588:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 99 00000100:00100000:0.0:1788836523.327599:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04809a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:462ae43d-104f-4dae-9208-57a489fa1d04+13:16882:x1875730518645376:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788836523.329943:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04809a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:462ae43d-104f-4dae-9208-57a489fa1d04+13:16882:x1875730518645376:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 2332us (2516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836523.329959:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 99 00000100:00100000:0.0:1788836523.339537:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836523.339897:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518645504 00000100:00100000:1.0:1788836523.339908:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518645504 00000100:00100000:1.0:1788836523.339973:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 100 00000100:00100000:1.0:1788836523.339983:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04809b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:462ae43d-104f-4dae-9208-57a489fa1d04+13:16895:x1875730518645504:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788836523.340256:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04809b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:462ae43d-104f-4dae-9208-57a489fa1d04+13:16895:x1875730518645504:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 273us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836523.340265:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 100 00000100:00100000:1.0:1788836523.344157:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836523.344266:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518645632 00000100:00100000:0.0:1788836523.344277:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518645632 00000100:00100000:0.0:1788836523.344398:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 101 00000100:00100000:0.0:1788836523.344431:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04809ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:462ae43d-104f-4dae-9208-57a489fa1d04+13:16895:x1875730518645632:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788836523.344747:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04809ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:462ae43d-104f-4dae-9208-57a489fa1d04+13:16895:x1875730518645632:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 337us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836523.344755:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 101 00000100:00100000:2.0:1788836523.354240:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836523.355444:0:20076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518645760 00000100:00100000:0.0:1788836523.355457:0:20076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518645760 00000100:00100000:0.0:1788836523.355520:0:20076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:0.0:1788836523.355528:0:20076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2352:x1875730518645760:12345-192.168.203.52@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788836523.355558:0:20076:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 95db1520-ad90-486a-963f-ce27a404b1dd@192.168.203.52@tcp t0 exp 0000000000000000 cur 576 last 0 00000020:00000080:0.0:1788836523.355597:0:20076:0:(genops.c:1385:class_connect()) connect: client 95db1520-ad90-486a-963f-ce27a404b1dd, cookie 0xcb5b7bc40b90ae3b 00000004:00100000:0.0:1788836523.355643:0:20076:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788836523.355777:0:20076:0:(import.c:65:import_set_state_nolock()) ffff9bd0818ab000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788836523.355867:0:20076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95db1520-ad90-486a-963f-ce27a404b1dd+6:2352:x1875730518645760:12345-192.168.203.52@tcp:38:mount.lustre.0 Request processed in 338us (1638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836523.355875:0:20076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:0.0:1788836523.359476:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836523.359902:0:18855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518646016 00000100:00100000:3.0:1788836523.359912:0:18855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518646016 00000100:00100000:3.0:1788836523.359988:0:18855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:3.0:1788836523.359999:0:18855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95db1520-ad90-486a-963f-ce27a404b1dd+6:16882:x1875730518646016:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788836523.360030:0:18855:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788836523.360113:0:18855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95db1520-ad90-486a-963f-ce27a404b1dd+6:16882:x1875730518646016:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 116us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836523.360121:0:18855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:2.0:1788836523.360304:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836523.360458:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518645888 00000100:00100000:1.0:1788836523.360464:0:18857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518645888 00000100:00100000:1.0:1788836523.360503:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:1.0:1788836523.360511:0:18857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95db1520-ad90-486a-963f-ce27a404b1dd+6:0:x1875730518645888:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788836523.360528:0:18857:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788836523.360563:0:18857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95db1520-ad90-486a-963f-ce27a404b1dd+6:0:x1875730518645888:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 54us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836523.360570:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00080000:0.0:1788836523.360869:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836523.366489:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836523.366710:0:18855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518646144 00000100:00100000:3.0:1788836523.366720:0:18855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518646144 00000100:00100000:3.0:1788836523.366788:0:18855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:3.0:1788836523.366800:0:18855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95db1520-ad90-486a-963f-ce27a404b1dd+6:16882:x1875730518646144:12345-192.168.203.52@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788836523.366893:0:18855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95db1520-ad90-486a-963f-ce27a404b1dd+6:16882:x1875730518646144:12345-192.168.203.52@tcp:40:mount.lustre.0 Request processed in 96us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836523.366900:0:18855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:0.0:1788836523.368733:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836523.368771:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836523.368804:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836523.368891:0:20128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518646272 00000100:00100000:1.0:1788836523.368899:0:20128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518646272 00000100:00100000:1.0:1788836523.368938:0:20128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518646400 00000100:00100000:1.0:1788836523.368942:0:20128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518646400 00000100:00100000:1.0:1788836523.368967:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:1.0:1788836523.368974:0:20128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2352:x1875730518646272:12345-192.168.203.52@tcp:8:mount.lustre.0 00000100:00100000:2.0:1788836523.368979:0:18859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518646528 00000100:00100000:2.0:1788836523.368985:0:18859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518646528 00010000:00080000:1.0:1788836523.369006:0:20128:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 95db1520-ad90-486a-963f-ce27a404b1dd@192.168.203.52@tcp t0 exp 0000000000000000 cur 576 last 0 00000100:00100000:2.0:1788836523.369027:0:18859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:2.0:1788836523.369038:0:18859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95db1520-ad90-486a-963f-ce27a404b1dd+6:16882:x1875730518646528:12345-192.168.203.52@tcp:33:mount.lustre.0 00000020:00000080:1.0:1788836523.369053:0:20128:0:(genops.c:1385:class_connect()) connect: client 95db1520-ad90-486a-963f-ce27a404b1dd, cookie 0xcb5b7bc40b90ae42 00002000:00100000:1.0:1788836523.369065:0:20128:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 95db1520-ad90-486a-963f-ce27a404b1dd/ffff9bcf45ece800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788836523.369076:0:20128:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000004:00200000:2.0:1788836523.369106:0:18859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00002000:00080000:1.0:1788836523.369180:0:20128:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:2.0:1788836523.369195:0:18859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95db1520-ad90-486a-963f-ce27a404b1dd+6:16882:x1875730518646528:12345-192.168.203.52@tcp:33:mount.lustre.0 Request processed in 158us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836523.369204:0:18859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:0.0:1788836523.369316:0:19539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:0.0:1788836523.369323:0:19539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875730518646400:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788836523.369340:0:19539:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 95db1520-ad90-486a-963f-ce27a404b1dd@192.168.203.52@tcp t0 exp 0000000000000000 cur 576 last 0 00000020:00000080:0.0:1788836523.369386:0:19539:0:(genops.c:1385:class_connect()) connect: client 95db1520-ad90-486a-963f-ce27a404b1dd, cookie 0xcb5b7bc40b90ae49 00002000:00100000:0.0:1788836523.369392:0:19539:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 95db1520-ad90-486a-963f-ce27a404b1dd/ffff9bd0818ae000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788836523.369399:0:19539:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788836523.369579:0:19539:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788836523.369596:0:19539:0:(import.c:65:import_set_state_nolock()) ffff9bd0818ae800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788836523.369634:0:19539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95db1520-ad90-486a-963f-ce27a404b1dd+6:2352:x1875730518646400:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 309us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836523.369643:0:19539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00080000:1.0:1788836523.369732:0:20128:0:(import.c:65:import_set_state_nolock()) ffff9bcf45ecd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788836523.369773:0:20128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95db1520-ad90-486a-963f-ce27a404b1dd+6:2352:x1875730518646272:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 798us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836523.369780:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:2.0:1788836523.523554:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836523.523663:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518646656 00000100:00100000:0.0:1788836523.523672:0:18856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518646656 00000100:00100000:0.0:1788836523.523733:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:0.0:1788836523.523743:0:18856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95db1520-ad90-486a-963f-ce27a404b1dd+6:16916:x1875730518646656:12345-192.168.203.52@tcp:101:mkdir.0 00010000:00010000:0.0:1788836523.523779:0:18856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836523.523802:0:18856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90ae50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ad16 expref: -99 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836523.523868:0:18856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90ae57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836523.523883:0:18856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90ae57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836523.523895:0:18856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90ae57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836523.523929:0:18856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788836523.523934:0:18856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788836523.523973:0:18856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90ae57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836523.524000:0:18856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90ae50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad16 expref: 8 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836523.524019:0:18856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90ae57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad16 expref: 7 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836523.524028:0:18856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04506a800) 00010000:00010000:0.0:1788836523.524031:0:18856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788836523.524035:0:18856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217c000, rc 0) 00000100:00100000:0.0:1788836523.524099:0:18856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95db1520-ad90-486a-963f-ce27a404b1dd+7:16916:x1875730518646656:12345-192.168.203.52@tcp:101:mkdir.0 Request processed in 356us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836523.524115:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000001:00100000:0.0:1788836523.891251:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 95db1520-ad90-486a-963f-ce27a404b1dd 00000001:00100000:0.0:1788836523.891266:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9f148df4-92ed-4188-b862-bd6c7c089260 00010000:00010000:1.0:1788836523.920751:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836524.881545:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538560000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836524.881619:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836524.882699:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538560000 00000100:00100000:3.0:1788836524.882710:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538560000 00000100:00100000:3.0:1788836524.882887:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788836524.882898:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538560000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788836524.882936:0:19544:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788836524.882997:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538560000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (1377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836524.883018:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788836524.883091:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538560000:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788836524.885373:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788836524.951433:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836525.968567:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788836525.995887:0:5851:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 95db1520-ad90-486a-963f-ce27a404b1dd 00000001:00100000:1.0:1788836525.995915:0:5851:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9f148df4-92ed-4188-b862-bd6c7c089260 00000001:02000400:3.0:1788836526.208960:0:20823:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000040:00080000:3.0:1788836526.546469:0:18889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788836526.993939:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836527.440813:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538560128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836527.440901:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836527.441247:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc96480a-9861-42d8-abb0-6f65502ae376:3304:1875730538560256:0@lo:400:kworker.0 00000100:00100000:2.0:1788836527.441286:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836527.441325:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875730538560768:0@lo:400:kworker.0 00000100:00100000:2.0:1788836527.441375:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836527.441400:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788836527.441406:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538560384:0@lo:400:kworker.0 00000100:00100000:2.0:1788836527.441428:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836527.441608:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538560512:0@lo:400:kworker.0 00000100:00100000:2.0:1788836527.441747:0:19539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538560384 00000100:00100000:2.0:1788836527.441754:0:19539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538560384 00000100:00100000:2.0:1788836527.441816:0:19539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788836527.441826:0:19539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538560384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836527.441908:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875730538560640:0@lo:400:kworker.0 00000100:00100000:0.0:1788836527.442592:0:19543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538560128 00000100:00100000:0.0:1788836527.442605:0:19543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538560128 00000100:00100000:0.0:1788836527.442733:0:19543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788836527.442744:0:19543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538560128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788836527.442880:0:19543:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788836527.443852:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836527.443952:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538560768 00000100:00100000:1.0:1788836527.443960:0:18857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538560768 00000100:00100000:1.0:1788836527.444016:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538560512 00000100:00100000:1.0:1788836527.444020:0:18857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538560512 00000100:00100000:1.0:1788836527.444044:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788836527.444054:0:18857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875730538560768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836527.444121:0:18857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875730538560768:12345-0@lo:400:kworker.0 Request processed in 68us (2744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836527.444154:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788836527.444180:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788836527.444187:0:18857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538560512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836527.444224:0:18857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538560512:12345-0@lo:400:kworker.0 Request processed in 38us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836527.444230:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788836527.444293:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875730538560768:0@lo:400:kworker.0 00000100:00100000:1.0:1788836527.444326:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538560512:0@lo:400:kworker.0 00000100:00080000:1.0:1788836527.444425:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788836527.444430:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788836527.444434:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836527.445320:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836527.445384:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538560256 00000100:00100000:3.0:1788836527.445391:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538560256 00000100:00100000:3.0:1788836527.445431:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788836527.445453:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04809bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+19:3304:x1875730538560256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836527.445732:0:19543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538560128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2989us (4829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836527.445741:0:19543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788836527.445809:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538560640 00000100:00100000:0.0:1788836527.445813:0:18857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538560640 00000100:00100000:0.0:1788836527.445848:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788836527.445855:0:18857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875730538560640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836527.445902:0:18857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875730538560640:12345-0@lo:400:kworker.0 Request processed in 48us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836527.445909:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788836527.445931:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836527.445994:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875730538560640:0@lo:400:kworker.0 00000100:00100000:0.0:1788836527.446015:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538560128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788836527.446269:0:19539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538560384:12345-0@lo:400:kworker.0 Request processed in 4443us (4837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836527.446279:0:19539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788836527.450266:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04809bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+19:3304:x1875730538560256:12345-0@lo:400:kworker.0 Request processed in 4817us (8967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836527.450282:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788836527.460787:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538560384:0@lo:400:kworker.0 00000100:00100000:1.0:1788836527.460809:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc96480a-9861-42d8-abb0-6f65502ae376:3304:1875730538560256:0@lo:400:kworker.0 00010000:00010000:1.0:1788836528.022986:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788836528.037845:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 95db1520-ad90-486a-963f-ce27a404b1dd 00000100:00100000:0.0:1788836528.841522:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836528.841570:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836528.841595:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836528.841626:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836528.841650:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836528.841667:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836528.841686:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836528.841715:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518647040 00000100:00100000:0.0:1788836528.841726:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518647040 00000100:00100000:0.0:1788836528.841770:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518647552 00000100:00100000:0.0:1788836528.841773:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518647552 00000100:00100000:0.0:1788836528.841783:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518647168 00000100:00100000:0.0:1788836528.841785:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518647168 00000100:00100000:0.0:1788836528.841794:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518647424 00000100:00100000:0.0:1788836528.841795:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518647424 00000100:00100000:0.0:1788836528.841811:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:0.0:1788836528.841821:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9f148df4-92ed-4188-b862-bd6c7c089260+5:2354:x1875730518647040:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788836528.842056:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518646784 00000100:00100000:1.0:1788836528.842061:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518646784 00000100:00100000:1.0:1788836528.842094:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 103 00000100:00100000:1.0:1788836528.842102:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd048099050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:462ae43d-104f-4dae-9208-57a489fa1d04+13:2354:x1875730518646784:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788836528.842179:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd048099050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:462ae43d-104f-4dae-9208-57a489fa1d04+13:2354:x1875730518646784:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 77us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836528.842187:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 103 00000100:00100000:1.0:1788836528.843044:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:1.0:1788836528.843055:0:20128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95db1520-ad90-486a-963f-ce27a404b1dd+5:2354:x1875730518647552:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788836528.843109:0:20128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95db1520-ad90-486a-963f-ce27a404b1dd+5:2354:x1875730518647552:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 54us (1480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836528.843118:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:1.0:1788836528.843146:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:1.0:1788836528.843153:0:20128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9f148df4-92ed-4188-b862-bd6c7c089260+5:2354:x1875730518647168:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788836528.843177:0:20128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9f148df4-92ed-4188-b862-bd6c7c089260+5:2354:x1875730518647168:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 25us (1510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836528.843183:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:0.0:1788836528.843613:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9f148df4-92ed-4188-b862-bd6c7c089260+5:2354:x1875730518647040:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 1792us (2042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836528.843621:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:0.0:1788836528.843637:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:0.0:1788836528.843645:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95db1520-ad90-486a-963f-ce27a404b1dd+5:2354:x1875730518647424:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836528.843669:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95db1520-ad90-486a-963f-ce27a404b1dd+5:2354:x1875730518647424:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 25us (1982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836528.843674:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:0.0:1788836528.843692:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518647296 00000100:00100000:0.0:1788836528.843698:0:18857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518647296 00000100:00100000:0.0:1788836528.844826:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518646912 00000100:00100000:0.0:1788836528.844847:0:18857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518646912 00000100:00100000:0.0:1788836528.844883:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:0.0:1788836528.844891:0:18857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95db1520-ad90-486a-963f-ce27a404b1dd+6:2354:x1875730518647296:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836528.845084:0:18857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95db1520-ad90-486a-963f-ce27a404b1dd+6:2354:x1875730518647296:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 193us (3487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836528.845093:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:0.0:1788836528.845111:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:0.0:1788836528.845118:0:18857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f148df4-92ed-4188-b862-bd6c7c089260+6:2354:x1875730518646912:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836528.845162:0:18857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f148df4-92ed-4188-b862-bd6c7c089260+6:2354:x1875730518646912:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 45us (3511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836528.845168:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00080000:0.0:1788836528.845206:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788836528.845211:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788836528.845214:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788836529.040539:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788836529.759228:0:20971:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff46653df0 20000000:00000080:0.0:1788836529.759246:0:20971:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bd0440ff800 uarg=0000000000000000 20000000:01000000:0.0:1788836529.759282:0:20971:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788836529.759288:0:20971:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788836529.759292:0:20971:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788836529.760290:0:20972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1788836529.760580:0:20971:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788836529.768002:0:20971:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788836529.768033:0:20971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd08217d600/0xcb5b7bc40b90ae5e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836529.768053:0:20971:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd08217ca00/0xcb5b7bc40b90ab1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90ab16 expref: 18 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836529.768132:0:20971:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd07978aa00/0xcb5b7bc40b90ab6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90ab63 expref: 18 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836529.768155:0:20971:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd060377000/0xcb5b7bc40b90acc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90acba expref: 18 pid: 18849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836529.768166:0:20971:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd0413d3600/0xcb5b7bc40b90adfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac8a expref: 12 pid: 18849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836529.768173:0:20971:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bcf44ab4a00/0xcb5b7bc40b90ae34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316acec expref: 12 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836529.768181:0:20971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd08217d600/0xcb5b7bc40b90ae5e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836529.768225:0:20971:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bcf44ab4a00/0xcb5b7bc40b90ae34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316acec expref: 12 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836529.768242:0:20971:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bcf44ab4a00/0xcb5b7bc40b90ae34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316acec expref: 12 pid: 18847 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836529.768257:0:20971:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20971:1875730538560896:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788836529.768703:0:20971:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd0413d3600/0xcb5b7bc40b90adfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac8a expref: 12 pid: 18849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836529.768713:0:20971:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd0413d3600/0xcb5b7bc40b90adfc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac8a expref: 12 pid: 18849 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836529.768723:0:20971:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20971:1875730538561024:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788836529.768758:0:20971:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd060377000/0xcb5b7bc40b90acc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b90acba expref: 18 pid: 18849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836529.768778:0:20971:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd060377000/0xcb5b7bc40b90acc1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b90acba expref: 18 pid: 18849 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836529.768789:0:20971:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20971:1875730538561152:0@lo:104: 00000100:00100000:0.0:1788836529.768828:0:20971:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788836529.768918:0:20971:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd07978aa00/0xcb5b7bc40b90ab6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b90ab63 expref: 18 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836529.768927:0:20971:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd07978aa00/0xcb5b7bc40b90ab6a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b90ab63 expref: 18 pid: 18850 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836529.768935:0:20971:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20971:1875730538561280:0@lo:104: 00000100:00100000:0.0:1788836529.768958:0:20971:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836529.774450:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836529.774543:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836529.774572:0:18842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518647680 00000100:00100000:1.0:1788836529.774580:0:18842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518647680 00010000:00010000:1.0:1788836529.774617:0:18842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bcf44ab4a00/0xcb5b7bc40b90ae34 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316acec expref: 13 pid: 18847 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836529.774646:0:18842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518647808 00000100:00100000:1.0:1788836529.774649:0:18842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518647808 00010000:00010000:1.0:1788836529.774662:0:18842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd0413d3600/0xcb5b7bc40b90adfc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac8a expref: 14 pid: 18849 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836529.774678:0:18842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:1.0:1788836529.774686:0:18842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:462ae43d-104f-4dae-9208-57a489fa1d04+14:2353:x1875730518647680:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836529.774701:0:18842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836529.774707:0:18842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bcf44ab4a00/0xcb5b7bc40b90ae34 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316acec expref: 14 pid: 18847 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836529.774720:0:18842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bcf44ab4a00/0xcb5b7bc40b90ae34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316acec expref: 14 pid: 18847 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836529.774752:0:18842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836529.774802:0:18842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:462ae43d-104f-4dae-9208-57a489fa1d04+14:2353:x1875730518647680:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 116us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836529.774810:0:18842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:1.0:1788836529.774830:0:18842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:1.0:1788836529.774836:0:18842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07accb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:462ae43d-104f-4dae-9208-57a489fa1d04+13:2354:x1875730518647808:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836529.774844:0:18842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836529.774848:0:18842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd0413d3600/0xcb5b7bc40b90adfc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac8a expref: 13 pid: 18849 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836529.774857:0:18842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd0413d3600/0xcb5b7bc40b90adfc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac8a expref: 13 pid: 18849 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836529.774867:0:18842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836529.774908:0:18842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07accb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:462ae43d-104f-4dae-9208-57a489fa1d04+13:2354:x1875730518647808:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 72us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836529.774916:0:18842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00010000:00010000:0.0:1788836529.776308:0:20971:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd08217ca00/0xcb5b7bc40b90ab1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b90ab16 expref: 18 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836529.776325:0:20971:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd08217ca00/0xcb5b7bc40b90ab1d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b90ab16 expref: 18 pid: 18850 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836529.776360:0:20971:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20971:1875730538561408:0@lo:104: 00000100:00100000:0.0:1788836529.776419:0:20971:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836529.776709:0:18839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538561152 00000100:00100000:3.0:1788836529.776717:0:18839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538561152 00000100:00100000:3.0:1788836529.776752:0:18839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538561280 00000100:00100000:3.0:1788836529.776755:0:18839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538561280 00000100:00100000:3.0:1788836529.776769:0:18839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788836529.776777:0:18839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc96480a-9861-42d8-abb0-6f65502ae376+4:20971:x1875730538561152:12345-0@lo:104: 00010000:00010000:3.0:1788836529.776789:0:18839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b90acba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90acc1 expref: -99 pid: 20260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836529.776840:0:18839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788836529.776847:0:18839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc96480a-9861-42d8-abb0-6f65502ae376+4:20971:x1875730538561152:12345-0@lo:104: Request processed in 71us (8019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836529.776868:0:18839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788836529.776983:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836529.776991:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b90acba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90acc1 expref: -99 pid: 20260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836529.777000:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040031c00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:2.0:1788836529.777004:0:18844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b90acba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b90acc1 expref: -99 pid: 20260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836529.777013:0:18844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b90acba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b90acc1 expref: -99 pid: 20260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836529.777021:0:18844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b90acba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b90acc1 expref: -99 pid: 20260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836529.777034:0:18844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788836529.777074:0:18844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b90acba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90acc1 expref: -99 pid: 20260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836529.777081:0:18844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836529.777101:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b90acba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90acc1 expref: -99 pid: 20260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836529.777109:0:18844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b90acba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90acc1 expref: -99 pid: 20260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836529.777129:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836529.777131:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836529.777133:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836529.777154:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc96480a-9861-42d8-abb0-6f65502ae376:3305:1875730538561536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788836529.777189:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836529.777237:0:18842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538561536 00000100:00100000:2.0:1788836529.777242:0:18842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538561536 00010000:00010000:2.0:1788836529.777259:0:18842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd060377000/0xcb5b7bc40b90acc1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90acba expref: 19 pid: 18849 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836529.777281:0:18842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788836529.777288:0:18842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44af2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc96480a-9861-42d8-abb0-6f65502ae376+19:3305:x1875730538561536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788836529.777297:0:18842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836529.777301:0:18842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd060377000/0xcb5b7bc40b90acc1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90acba expref: 19 pid: 18849 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836529.777311:0:18842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd060377000/0xcb5b7bc40b90acc1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b90acba expref: 19 pid: 18849 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836529.777333:0:18842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836529.777382:0:18842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44af2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc96480a-9861-42d8-abb0-6f65502ae376+19:3305:x1875730538561536:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836529.777389:0:18842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788836529.777461:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc96480a-9861-42d8-abb0-6f65502ae376:3305:1875730538561536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836529.777742:0:18839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788836529.777752:0:18839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc96480a-9861-42d8-abb0-6f65502ae376+3:20971:x1875730538561280:12345-0@lo:104: 00010000:00010000:3.0:1788836529.777761:0:18839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd040031800/0xcb5b7bc40b90ab63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90ab6a expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836529.777807:0:18839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788836529.777812:0:18839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc96480a-9861-42d8-abb0-6f65502ae376+3:20971:x1875730538561280:12345-0@lo:104: Request processed in 64us (8854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836529.777818:0:18839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788836529.777864:0:20131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836529.777879:0:20131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd040031800/0xcb5b7bc40b90ab63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90ab6a expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836529.777887:0:20131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040031800 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:2.0:1788836529.777890:0:20131:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd040031800/0xcb5b7bc40b90ab63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b90ab6a expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836529.777995:0:20131:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd040031800/0xcb5b7bc40b90ab63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b90ab6a expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836529.778002:0:20131:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd040031800/0xcb5b7bc40b90ab63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b90ab6a expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836529.778007:0:20131:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788836529.778036:0:20131:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd040031800/0xcb5b7bc40b90ab63 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90ab6a expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836529.778043:0:20131:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836529.778165:0:20131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd040031800/0xcb5b7bc40b90ab63 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90ab6a expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836529.778173:0:20131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd040031800/0xcb5b7bc40b90ab63 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90ab6a expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836529.778193:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836529.778195:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836529.778196:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836529.778209:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc96480a-9861-42d8-abb0-6f65502ae376:3302:1875730538561664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788836529.778238:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836529.778276:0:18841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538561664 00000100:00100000:2.0:1788836529.778281:0:18841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538561664 00010000:00010000:2.0:1788836529.778299:0:18841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd07978aa00/0xcb5b7bc40b90ab6a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90ab63 expref: 19 pid: 18850 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836529.778320:0:18841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788836529.778327:0:18841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b255880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc96480a-9861-42d8-abb0-6f65502ae376+19:3302:x1875730538561664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788836529.778336:0:18841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836529.778364:0:18841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd07978aa00/0xcb5b7bc40b90ab6a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90ab63 expref: 19 pid: 18850 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836529.778375:0:18841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd07978aa00/0xcb5b7bc40b90ab6a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b90ab63 expref: 19 pid: 18850 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836529.778386:0:18841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836529.778580:0:18841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b255880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc96480a-9861-42d8-abb0-6f65502ae376+19:3302:x1875730538561664:12345-0@lo:103:ldlm_bl.0 Request processed in 252us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836529.778587:0:18841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788836529.778616:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc96480a-9861-42d8-abb0-6f65502ae376:3302:1875730538561664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836529.778712:0:20971:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd049719b40 going to sleep for 11 seconds 00010000:00010000:0.0:1788836529.778730:0:20971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bcf44ab4a00/0xcb5b7bc40b90ae34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316acec expref: 12 pid: 18847 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836529.778742:0:20971:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20971:1875730538560896:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788836529.778755:0:20971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd0413d3600/0xcb5b7bc40b90adfc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac8a expref: 11 pid: 18849 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836529.778779:0:20971:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20971:1875730538561024:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788836529.778793:0:20971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd060377000/0xcb5b7bc40b90acc1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b90acba expref: 18 pid: 18849 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836529.778802:0:20971:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20971:1875730538561152:0@lo:104: 00010000:00010000:0.0:1788836529.778810:0:20971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd07978aa00/0xcb5b7bc40b90ab6a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b90ab63 expref: 17 pid: 18850 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836529.778817:0:20971:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20971:1875730538561280:0@lo:104: 00000100:00100000:3.0:1788836529.779006:0:18839:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788836529.779018:0:18839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538561408 00000100:00100000:3.0:1788836529.779022:0:18839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538561408 00000100:00100000:3.0:1788836529.779045:0:18839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788836529.779051:0:18839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc96480a-9861-42d8-abb0-6f65502ae376+3:20971:x1875730538561408:12345-0@lo:104: 00010000:00010000:3.0:1788836529.779138:0:18839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd040031600/0xcb5b7bc40b90ab16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90ab1d expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836529.779191:0:18839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788836529.779197:0:18839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc96480a-9861-42d8-abb0-6f65502ae376+3:20971:x1875730538561408:12345-0@lo:104: Request processed in 147us (2779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836529.779204:0:18839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788836529.779265:0:18843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836529.779271:0:18843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd040031600/0xcb5b7bc40b90ab16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90ab1d expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836529.779287:0:18843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040031600 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:2.0:1788836529.779291:0:18843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd040031600/0xcb5b7bc40b90ab16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b90ab1d expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836529.779298:0:18843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd040031600/0xcb5b7bc40b90ab16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b90ab1d expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836529.779305:0:18843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd040031600/0xcb5b7bc40b90ab16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b90ab1d expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836529.779310:0:18843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788836529.779336:0:18843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd040031600/0xcb5b7bc40b90ab16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90ab1d expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836529.779363:0:18843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836529.779382:0:18843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd040031600/0xcb5b7bc40b90ab16 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90ab1d expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836529.779389:0:18843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd040031600/0xcb5b7bc40b90ab16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90ab1d expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836529.779392:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc96480a-9861-42d8-abb0-6f65502ae376:3303:1875730538561792:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788836529.779403:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836529.779405:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836529.779406:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836529.779424:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836529.779558:0:18840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538561792 00000100:00100000:2.0:1788836529.779563:0:18840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538561792 00010000:00010000:2.0:1788836529.779579:0:18840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd08217ca00/0xcb5b7bc40b90ab1d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90ab16 expref: 17 pid: 18850 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836529.779605:0:18840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788836529.779618:0:18840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07accad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc96480a-9861-42d8-abb0-6f65502ae376+17:3303:x1875730538561792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788836529.779627:0:18840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836529.779631:0:18840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd08217ca00/0xcb5b7bc40b90ab1d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90ab16 expref: 17 pid: 18850 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836529.779640:0:18840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd08217ca00/0xcb5b7bc40b90ab1d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b90ab16 expref: 17 pid: 18850 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836529.779654:0:18840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd08217d600/0xcb5b7bc40b90ae5e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836529.779662:0:18840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd08217d600/0xcb5b7bc40b90ae5e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836529.779675:0:18840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd08217d600/0xcb5b7bc40b90ae5e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836529.779682:0:18840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd08217d600/0xcb5b7bc40b90ae5e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836529.779688:0:18840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd08217d600/0xcb5b7bc40b90ae5e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836529.779694:0:18840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd08217d600/0xcb5b7bc40b90ae5e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836529.779699:0:18840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217d600 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836529.779703:0:18840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd08217d600/0xcb5b7bc40b90ae5e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836529.779711:0:18840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd08217d600/0xcb5b7bc40b90ae5e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836529.779725:0:18840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd08217d600/0xcb5b7bc40b90ae5e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836529.779734:0:18840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836529.779771:0:18840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07accad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc96480a-9861-42d8-abb0-6f65502ae376+17:3303:x1875730538561792:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836529.779777:0:18840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788836529.779819:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc96480a-9861-42d8-abb0-6f65502ae376:3303:1875730538561792:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836529.780175:0:20971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd08217ca00/0xcb5b7bc40b90ab1d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b90ab16 expref: 16 pid: 18850 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836529.780185:0:20971:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20971:1875730538561408:0@lo:104: 00010000:00010000:0.0:1788836529.780223:0:20971:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd08217d600/0xcb5b7bc40b90ae5e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836529.780233:0:20971:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd08217d600/0xcb5b7bc40b90ae5e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836529.780239:0:20971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd08217d600/0xcb5b7bc40b90ae5e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836529.780244:0:20971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd08217d600/0xcb5b7bc40b90ae5e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836530.002371:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538561920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836530.002438:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836530.002524:0:19543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538561920 00000100:00100000:3.0:1788836530.002533:0:19543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538561920 00000100:00100000:3.0:1788836530.002606:0:19543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788836530.002617:0:19543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538561920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788836530.002652:0:19543:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788836530.002711:0:19543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538561920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836530.002719:0:19543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788836530.002775:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836530.002813:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538561920:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788836530.064910:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788836531.024463:0:18853:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788836531.024470:0:18853:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd07a3ae800 from 10 10000000:01000000:3.0:1788836531.024476:0:18853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788836531.024526:0:18853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2400/0xcb5b7bc40b90ae65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.024539:0:18853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2400/0xcb5b7bc40b90ae65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.024550:0:18853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2400/0xcb5b7bc40b90ae65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836531.024576:0:18853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538562048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788836531.024642:0:18853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836531.024694:0:18853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd043178b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788836531.024935:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538562048 00000100:00100000:0.0:1788836531.024943:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538562048 00000100:00100000:0.0:1788836531.024987:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788836531.025006:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd048098450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+16:18853:x1875730538562048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836531.025019:0:18850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836531.025033:0:18850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd08217ca00/0xcb5b7bc40b90ae6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90ae65 expref: -99 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.025056:0:18850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd08217ca00/0xcb5b7bc40b90ae6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90ae65 expref: 17 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.025065:0:18850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd08217ca00/0xcb5b7bc40b90ae6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90ae65 expref: 17 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.025075:0:18850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217ca00, rc 0) 00000100:00100000:0.0:1788836531.025148:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd048098450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+17:18853:x1875730538562048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836531.025155:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788836531.025300:0:18853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538562048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836531.025315:0:18853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2400/0xcb5b7bc40b90ae65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90ae6c expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836531.025323:0:18853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2400/0xcb5b7bc40b90ae65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90ae6c expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836531.025395:0:18853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b255c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538562176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836531.025421:0:18853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836531.025447:0:18853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd079ea1300 going to sleep for 11 seconds 00000100:00100000:1.0:1788836531.027340:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538562176 00000100:00100000:1.0:1788836531.027367:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538562176 00000100:00100000:1.0:1788836531.027414:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788836531.027423:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd048098050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+17:18853:x1875730538562176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836531.028055:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd048098050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+17:18853:x1875730538562176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 631us (2630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836531.028071:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788836531.028417:0:18853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b255c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538562176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836531.028460:0:18853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538562304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788836531.028510:0:18853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836531.028544:0:18853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd043178cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836531.030210:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538562304 00000100:00100000:0.0:1788836531.030222:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538562304 00000100:00100000:0.0:1788836531.030277:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788836531.030287:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04809a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+17:18853:x1875730538562304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836531.030524:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04809a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+17:18853:x1875730538562304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 238us (2013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836531.030531:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788836531.030592:0:18853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538562304:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788836531.037738:0:20984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788836531.039878:0:18853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788836531.039925:0:18853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788836531.039939:0:18853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2400/0xcb5b7bc40b90ae65 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90ae6c expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.039973:0:18853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2400/0xcb5b7bc40b90ae65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90ae6c expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836531.039985:0:18853:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788836531.039988:0:18853:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd047f4c000 from 10 10000000:01000000:0.0:1788836531.039991:0:18853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788836531.040030:0:18853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd08217d200/0xcb5b7bc40b90ae73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.040038:0:18853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd08217d200/0xcb5b7bc40b90ae73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.040048:0:18853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd08217d200/0xcb5b7bc40b90ae73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836531.040073:0:18853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538562432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788836531.046033:0:18853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836531.046082:0:18853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0497190c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836531.046164:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538562432 00000100:00100000:2.0:1788836531.046174:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538562432 00000100:00100000:2.0:1788836531.046225:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788836531.046235:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd048099850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+17:18853:x1875730538562432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836531.046266:0:18847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836531.046284:0:18847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd07efb2800/0xcb5b7bc40b90ae7a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90ae73 expref: -99 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836531.046312:0:18847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd07efb2800/0xcb5b7bc40b90ae7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90ae73 expref: 18 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836531.046323:0:18847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd07efb2800/0xcb5b7bc40b90ae7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90ae73 expref: 18 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836531.046332:0:18847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07efb2800, rc 0) 00000100:00100000:2.0:1788836531.046412:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd048099850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+18:18853:x1875730538562432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836531.046419:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788836531.048909:0:18853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538562432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836531.048937:0:18853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd08217d200/0xcb5b7bc40b90ae73 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90ae7a expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.048950:0:18853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd08217d200/0xcb5b7bc40b90ae73 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90ae7a expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836531.049027:0:18853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538562560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836531.049082:0:18853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836531.049147:0:18853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0497190c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836531.049213:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538562560 00000100:00100000:1.0:1788836531.049219:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538562560 00000100:00100000:1.0:1788836531.049257:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788836531.049265:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04809b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+18:18853:x1875730538562560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836531.049526:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04809b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+18:18853:x1875730538562560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836531.049534:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788836531.051492:0:18853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538562560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836531.051552:0:18853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538562688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836531.051625:0:18853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836531.051667:0:18853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0497190c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836531.051890:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538562688 00000100:00100000:3.0:1788836531.051898:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538562688 00000100:00100000:3.0:1788836531.051947:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788836531.051956:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd048099c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+18:18853:x1875730538562688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788836531.052154:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd048099c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+18:18853:x1875730538562688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 198us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836531.052170:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788836531.052682:0:18853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538562688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788836531.054889:0:20985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788836531.056423:0:18853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788836531.056451:0:18853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788836531.056462:0:18853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd08217d200/0xcb5b7bc40b90ae73 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90ae7a expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.056475:0:18853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd08217d200/0xcb5b7bc40b90ae73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90ae7a expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836531.056487:0:18853:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788836531.056490:0:18853:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bcf46073800 from 10 10000000:01000000:0.0:1788836531.056493:0:18853:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788836531.056532:0:18853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd08217c600/0xcb5b7bc40b90ae81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.056540:0:18853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd08217c600/0xcb5b7bc40b90ae81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.056551:0:18853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd08217c600/0xcb5b7bc40b90ae81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836531.056576:0:18853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538562816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788836531.056645:0:18853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836531.056702:0:18853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd049719180 going to sleep for 11 seconds 00000100:00100000:2.0:1788836531.056938:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538562816 00000100:00100000:2.0:1788836531.056946:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538562816 00000100:00100000:2.0:1788836531.057197:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788836531.057208:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd048099450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+18:18853:x1875730538562816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836531.057220:0:18847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836531.057234:0:18847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd07efb2200/0xcb5b7bc40b90ae88 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90ae81 expref: -99 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836531.057258:0:18847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd07efb2200/0xcb5b7bc40b90ae88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90ae81 expref: 19 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836531.057269:0:18847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd07efb2200/0xcb5b7bc40b90ae88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90ae81 expref: 19 pid: 18847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836531.057290:0:18847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07efb2200, rc 0) 00000100:00100000:2.0:1788836531.057362:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd048099450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc96480a-9861-42d8-abb0-6f65502ae376+19:18853:x1875730538562816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836531.057369:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788836531.057460:0:18853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538562816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836531.057474:0:18853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd08217c600/0xcb5b7bc40b90ae81 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90ae88 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.057484:0:18853:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd08217c600/0xcb5b7bc40b90ae81 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90ae88 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836531.057539:0:18853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538562944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836531.057567:0:18853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836531.063425:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538562944 00000100:00100000:3.0:1788836531.063438:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538562944 00000100:00100000:3.0:1788836531.063501:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788836531.063511:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04809a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+19:18853:x1875730538562944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836531.063678:0:18853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd049719180 going to sleep for 11 seconds 00000100:00100000:3.0:1788836531.063796:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04809a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc96480a-9861-42d8-abb0-6f65502ae376+19:18853:x1875730538562944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 286us (6226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836531.063804:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788836531.063830:0:18853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538562944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836531.063893:0:18853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538563072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788836531.063941:0:18853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836531.063965:0:18853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046707cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836531.064107:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538563072 00000100:00100000:0.0:1788836531.064122:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538563072 00000100:00100000:0.0:1788836531.064157:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788836531.064164:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04809b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+19:18853:x1875730538563072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836531.064314:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04809b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+19:18853:x1875730538563072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836531.064321:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788836531.064433:0:18853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc96480a-9861-42d8-abb0-6f65502ae376:18853:1875730538563072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788836531.065335:0:20987:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788836531.066789:0:18853:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788836531.066817:0:18853:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788836531.066828:0:18853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd08217c600/0xcb5b7bc40b90ae81 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90ae88 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.066840:0:18853:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd08217c600/0xcb5b7bc40b90ae81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90ae88 expref: -99 pid: 18853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836531.088622:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836531.125492:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836531.125553:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518647936 00000100:00100000:0.0:1788836531.125563:0:18857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518647936 00000100:00100000:0.0:1788836531.125627:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:0.0:1788836531.125637:0:18857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f148df4-92ed-4188-b862-bd6c7c089260+6:17379:x1875730518647936:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788836531.125656:0:18857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836531.125675:0:18857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90ae8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ad1d expref: -99 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.125739:0:18857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90ae96 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.125782:0:18857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90ae96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.125794:0:18857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90ae96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.125808:0:18857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90ae9d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.125815:0:18857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90ae9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.125822:0:18857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90ae9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788836531.126299:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788836531.126386:0:18857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90aea4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.126396:0:18857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90aea4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.126403:0:18857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90aea4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836531.126425:0:18857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788836531.126429:0:18857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788836531.126462:0:18857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90aea4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.126472:0:18857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90ae96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.126488:0:18857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90ae96 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.126495:0:18857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90ae96 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.126500:0:18857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217d800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836531.126505:0:18857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90ae96 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.126512:0:18857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90ae96 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.126525:0:18857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04506a800) 00010000:00010000:0.0:1788836531.126528:0:18857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836531.126532:0:18857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90ae96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.126538:0:18857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90ae96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.126549:0:18857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90ae9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.126555:0:18857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90ae9d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.126561:0:18857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90ae9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.126567:0:18857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217c400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836531.126575:0:18857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90ae9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.126582:0:18857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90ae9d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.126590:0:18857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9bd0498edc00) 00010000:00010000:0.0:1788836531.126593:0:18857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836531.126596:0:18857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90ae9d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.126601:0:18857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90ae9d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.126636:0:18857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90ae8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad1d expref: 8 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.126649:0:18857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90aea4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad1d expref: 7 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.126656:0:18857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bd0498ed000) 00010000:00010000:0.0:1788836531.126658:0:18857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788836531.126661:0:18857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217d000, rc 0) 00000100:00100000:0.0:1788836531.126721:0:18857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f148df4-92ed-4188-b862-bd6c7c089260+7:17379:x1875730518647936:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 1085us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836531.126729:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:1.0:1788836531.132626:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836531.132754:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518648192 00000100:00100000:3.0:1788836531.132764:0:18856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518648192 00000100:00100000:3.0:1788836531.132820:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:3.0:1788836531.132830:0:18856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f148df4-92ed-4188-b862-bd6c7c089260+7:17379:x1875730518648192:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788836531.132851:0:18856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836531.132882:0:18856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2000/0xcb5b7bc40b90aeab lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ad24 expref: -99 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.133202:0:18856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d3a00/0xcb5b7bc40b90aeb2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.133218:0:18856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d3a00/0xcb5b7bc40b90aeb2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.133230:0:18856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d3a00/0xcb5b7bc40b90aeb2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.133245:0:18856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2c00/0xcb5b7bc40b90aeb9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.133270:0:18856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2c00/0xcb5b7bc40b90aeb9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.133277:0:18856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2c00/0xcb5b7bc40b90aeb9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.133619:0:18856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d3400/0xcb5b7bc40b90aec0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.133628:0:18856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d3400/0xcb5b7bc40b90aec0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.133635:0:18856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d3400/0xcb5b7bc40b90aec0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836531.133645:0:18856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788836531.133834:0:18856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d3a00/0xcb5b7bc40b90aeb2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.133842:0:18856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d3a00/0xcb5b7bc40b90aeb2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.133849:0:18856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d3a00/0xcb5b7bc40b90aeb2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.133863:0:18856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0413d3a00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836531.133868:0:18856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d3a00/0xcb5b7bc40b90aeb2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.133874:0:18856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d3a00/0xcb5b7bc40b90aeb2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.133912:0:18856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bd0498ed000) 00010000:00010000:3.0:1788836531.133915:0:18856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836531.133920:0:18856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d3a00/0xcb5b7bc40b90aeb2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.133927:0:18856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d3a00/0xcb5b7bc40b90aeb2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.133941:0:18856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2c00/0xcb5b7bc40b90aeb9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.133947:0:18856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2c00/0xcb5b7bc40b90aeb9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.133953:0:18856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2c00/0xcb5b7bc40b90aeb9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.133958:0:18856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0413d2c00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836531.133970:0:18856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2c00/0xcb5b7bc40b90aeb9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.133975:0:18856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2c00/0xcb5b7bc40b90aeb9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.133983:0:18856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9bd04506a900) 00010000:00010000:3.0:1788836531.133985:0:18856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836531.133988:0:18856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2c00/0xcb5b7bc40b90aeb9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.133994:0:18856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2c00/0xcb5b7bc40b90aeb9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.134801:0:18856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2000/0xcb5b7bc40b90aeab lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad24 expref: 10 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.134821:0:18856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d3400/0xcb5b7bc40b90aec0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad24 expref: 9 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.134829:0:18856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd04506ac00) 00010000:00010000:3.0:1788836531.134831:0:18856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836531.134833:0:18856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0413d3400, rc 0) 00000100:00100000:3.0:1788836531.134913:0:18856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f148df4-92ed-4188-b862-bd6c7c089260+9:17379:x1875730518648192:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 2084us (2297us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788836531.134922:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:2.0:1788836531.144663:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836531.144923:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518648320 00000100:00100000:0.0:1788836531.144934:0:18857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518648320 00000100:00100000:0.0:1788836531.144983:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:0.0:1788836531.144993:0:18857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f148df4-92ed-4188-b862-bd6c7c089260+9:17379:x1875730518648320:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788836531.145135:0:18857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f148df4-92ed-4188-b862-bd6c7c089260+9:17379:x1875730518648320:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 Request processed in 143us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836531.145143:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:2.0:1788836531.210116:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836531.210201:0:20076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518648448 00000100:00100000:0.0:1788836531.210216:0:20076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518648448 00000100:00100000:0.0:1788836531.210288:0:20076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:0.0:1788836531.210299:0:20076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f148df4-92ed-4188-b862-bd6c7c089260+9:17385:x1875730518648448:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788836531.210322:0:20076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836531.210395:0:20076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90aece lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ad2b expref: -99 pid: 20076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.210459:0:20076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90aed5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.210473:0:20076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90aed5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.210484:0:20076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90aed5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.210497:0:20076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90aedc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.210504:0:20076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90aedc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.210509:0:20076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90aedc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.211006:0:20076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90aed5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.211022:0:20076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90aed5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.211029:0:20076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90aed5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.211035:0:20076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217c400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836531.211039:0:20076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90aed5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.211047:0:20076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90aed5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.211060:0:20076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04506a800) 00010000:00010000:0.0:1788836531.211063:0:20076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836531.211067:0:20076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90aed5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.211072:0:20076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90aed5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.211084:0:20076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90aedc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.211089:0:20076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90aedc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.211093:0:20076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90aedc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.211097:0:20076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217d800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836531.211105:0:20076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90aedc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.211123:0:20076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90aedc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.211132:0:20076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9bd0498edc00) 00010000:00010000:0.0:1788836531.211135:0:20076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836531.211138:0:20076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90aedc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.211143:0:20076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90aedc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.211179:0:20076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90aece lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad2b expref: 10 pid: 20076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.211187:0:20076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04506a800) 00010000:00010000:0.0:1788836531.211189:0:20076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836531.211192:0:20076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90aece lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad2b expref: 10 pid: 20076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.211200:0:20076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217d600, rc 0) 00000100:00100000:0.0:1788836531.211271:0:20076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f148df4-92ed-4188-b862-bd6c7c089260+9:17385:x1875730518648448:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 973us (1970us total) trans 0 rc 301/301 00000100:00100000:0.0:1788836531.211278:0:20076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:1.0:1788836531.223060:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836531.223284:0:18864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518648576 00000100:00100000:0.0:1788836531.223297:0:18864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518648576 00000100:00100000:2.0:1788836531.223721:0:18864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:2.0:1788836531.223738:0:18864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9f148df4-92ed-4188-b862-bd6c7c089260+9:17385:x1875730518648576:12345-192.168.203.52@tcp:700:lfs.0 00000100:00100000:2.0:1788836531.224081:0:18864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9f148df4-92ed-4188-b862-bd6c7c089260+9:17385:x1875730518648576:12345-192.168.203.52@tcp:700:lfs.0 Request processed in 127us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836531.224091:0:18864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:1.0:1788836531.227585:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836531.228159:0:18855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518648832 00000100:00100000:0.0:1788836531.228173:0:18855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518648832 00000100:00100000:0.0:1788836531.228316:0:18855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:0.0:1788836531.228329:0:18855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f148df4-92ed-4188-b862-bd6c7c089260+9:17385:x1875730518648832:12345-192.168.203.52@tcp:36:lfs.0 00010000:00010000:0.0:1788836531.228462:0:18855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836531.228508:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2a00/0xcb5b7bc40b90ae1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316acb4 expref: 9 pid: 18855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.228533:0:18855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04506a800) 00010000:00010000:0.0:1788836531.228540:0:18855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788836531.228807:0:18855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90aee3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.228825:0:18855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90ae57 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad16 expref: 5 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.228835:0:18855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90aee3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.228902:0:18855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90ae57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad16 expref: 5 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.228919:0:18855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90ae57 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad16 expref: 5 pid: 18856 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836531.228937:0:18855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18855:1875730538563200:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788836531.229067:0:18855:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0497190c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836531.233155:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836531.233156:0:18855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18855:1875730538563200:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788836531.233199:0:18855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90aee3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836531.233704:0:18842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518648960 00000100:00100000:2.0:1788836531.233715:0:18842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518648960 00010000:00010000:2.0:1788836531.233789:0:18842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90ae57 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad16 expref: 6 pid: 18856 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836531.233835:0:18842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:2.0:1788836531.233847:0:18842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:95db1520-ad90-486a-963f-ce27a404b1dd+6:2353:x1875730518648960:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836531.233875:0:18842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836531.233883:0:18842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90ae57 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad16 expref: 6 pid: 18856 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836531.233919:0:18842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90ae57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad16 expref: 6 pid: 18856 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836531.233948:0:18842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90ae57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad16 expref: 6 pid: 18856 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836531.233968:0:18842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04506a800) 00010000:00010000:2.0:1788836531.233975:0:18842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90aee3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836531.233985:0:18842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90aee3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836531.233993:0:18842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90aee3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836531.234020:0:18842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836531.234085:0:18842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:95db1520-ad90-486a-963f-ce27a404b1dd+5:2353:x1875730518648960:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 239us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836531.234092:0:18842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00080000:0.0:1788836531.234192:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788836531.234673:0:18855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90aee3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.234684:0:18855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90aee3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.234715:0:18855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2000/0xcb5b7bc40b90aeea lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.234728:0:18855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2000/0xcb5b7bc40b90aeea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.234737:0:18855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2000/0xcb5b7bc40b90aeea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836531.238630:0:18855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788836531.238662:0:18855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90aee3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.238675:0:18855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90aee3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.238684:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90aee3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.238692:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217d600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836531.238698:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90aee3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.238707:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90aee3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.238730:0:18855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04506a800) 00010000:00010000:3.0:1788836531.238733:0:18855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836531.238740:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90aee3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.238746:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90aee3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788836531.238775:0:18855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002fbb857e reply state 00000000cb9f1f6c transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2000/0xcb5b7bc40b90aeea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836531.238785:0:18855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788836531.239054:0:18855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f148df4-92ed-4188-b862-bd6c7c089260+10:17385:x1875730518648832:12345-192.168.203.52@tcp:36:lfs.0 Request processed in 10721us (11475us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788836531.239064:0:18855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00010000:00010000:3.0:1788836531.245068:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2000/0xcb5b7bc40b90aeea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.245102:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2000/0xcb5b7bc40b90aeea lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.245121:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2000/0xcb5b7bc40b90aeea lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.245128:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0413d2000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836531.245134:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2000/0xcb5b7bc40b90aeea lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.245143:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2000/0xcb5b7bc40b90aeea lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.245164:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9bd04506a900) 00010000:00010000:3.0:1788836531.245168:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836531.245174:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2000/0xcb5b7bc40b90aeea lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.245181:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2000/0xcb5b7bc40b90aeea lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836531.306064:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836531.306187:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518649088 00000100:00100000:3.0:1788836531.306201:0:18856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518649088 00000100:00100000:3.0:1788836531.306279:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:3.0:1788836531.306291:0:18856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f148df4-92ed-4188-b862-bd6c7c089260+9:17393:x1875730518649088:12345-192.168.203.52@tcp:101:lctl.0 00010000:00010000:3.0:1788836531.306322:0:18856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836531.306398:0:18856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2000/0xcb5b7bc40b90aef1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ad32 expref: -99 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.306508:0:18856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2c00/0xcb5b7bc40b90aef8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.306526:0:18856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2c00/0xcb5b7bc40b90aef8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.306541:0:18856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2c00/0xcb5b7bc40b90aef8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836531.306729:0:18856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788836531.306734:0:18856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788836531.306785:0:18856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2c00/0xcb5b7bc40b90aef8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.306817:0:18856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2000/0xcb5b7bc40b90aef1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad32 expref: 11 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.306841:0:18856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2c00/0xcb5b7bc40b90aef8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad32 expref: 10 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.306850:0:18856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04506a900) 00010000:00010000:3.0:1788836531.306853:0:18856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788836531.306857:0:18856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0413d2c00, rc 0) 00000100:00100000:3.0:1788836531.306939:0:18856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f148df4-92ed-4188-b862-bd6c7c089260+10:17393:x1875730518649088:12345-192.168.203.52@tcp:101:lctl.0 Request processed in 650us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836531.306947:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:2.0:1788836531.338263:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836531.338382:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518649216 00000100:00100000:1.0:1788836531.338396:0:18857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518649216 00000100:00100000:1.0:1788836531.338540:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:1.0:1788836531.338553:0:18857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95db1520-ad90-486a-963f-ce27a404b1dd+5:17394:x1875730518649216:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788836531.338581:0:18857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836531.338730:0:18857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5000/0xcb5b7bc40b90aeff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ad39 expref: -99 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.338812:0:18857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4200/0xcb5b7bc40b90af06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.338829:0:18857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4200/0xcb5b7bc40b90af06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.338842:0:18857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4200/0xcb5b7bc40b90af06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836531.338888:0:18857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788836531.338893:0:18857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788836531.338919:0:18857:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4200/0xcb5b7bc40b90af06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.338950:0:18857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5000/0xcb5b7bc40b90aeff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad39 expref: 7 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.339037:0:18857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4200/0xcb5b7bc40b90af06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad39 expref: 6 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.339049:0:18857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04506a900) 00010000:00010000:1.0:1788836531.339071:0:18857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788836531.339075:0:18857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bcf44ab4200, rc 0) 00000100:00100000:1.0:1788836531.339174:0:18857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95db1520-ad90-486a-963f-ce27a404b1dd+6:17394:x1875730518649216:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 624us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836531.339181:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:2.0:1788836531.342187:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836531.342304:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518649344 00000100:00100000:3.0:1788836531.342317:0:18856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518649344 00000100:00100000:3.0:1788836531.342501:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:3.0:1788836531.342514:0:18856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95db1520-ad90-486a-963f-ce27a404b1dd+6:17394:x1875730518649344:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788836531.342541:0:18856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836531.342567:0:18856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2000/0xcb5b7bc40b90af0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ad40 expref: -99 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.343088:0:18856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d3a00/0xcb5b7bc40b90af14 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.343116:0:18856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d3a00/0xcb5b7bc40b90af14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.343132:0:18856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d3a00/0xcb5b7bc40b90af14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.343151:0:18856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2a00/0xcb5b7bc40b90af1b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.343157:0:18856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2a00/0xcb5b7bc40b90af1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.343161:0:18856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2a00/0xcb5b7bc40b90af1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.343252:0:18856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d3600/0xcb5b7bc40b90af22 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.343257:0:18856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d3600/0xcb5b7bc40b90af22 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.343261:0:18856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d3600/0xcb5b7bc40b90af22 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836531.343304:0:18856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788836531.343306:0:18856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788836531.343324:0:18856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d3600/0xcb5b7bc40b90af22 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.343335:0:18856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d3a00/0xcb5b7bc40b90af14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.343488:0:18856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d3a00/0xcb5b7bc40b90af14 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.343496:0:18856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d3a00/0xcb5b7bc40b90af14 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.343500:0:18856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0413d3a00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836531.343504:0:18856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d3a00/0xcb5b7bc40b90af14 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.343511:0:18856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d3a00/0xcb5b7bc40b90af14 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.343522:0:18856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04506a900) 00010000:00010000:3.0:1788836531.343525:0:18856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836531.343528:0:18856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d3a00/0xcb5b7bc40b90af14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.343532:0:18856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d3a00/0xcb5b7bc40b90af14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.343546:0:18856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2a00/0xcb5b7bc40b90af1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.343557:0:18856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2a00/0xcb5b7bc40b90af1b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.343561:0:18856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2a00/0xcb5b7bc40b90af1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.343564:0:18856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0413d2a00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836531.343566:0:18856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2a00/0xcb5b7bc40b90af1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.343569:0:18856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2a00/0xcb5b7bc40b90af1b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.343573:0:18856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9bd04506a800) 00010000:00010000:3.0:1788836531.343574:0:18856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836531.343576:0:18856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2a00/0xcb5b7bc40b90af1b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.343579:0:18856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2a00/0xcb5b7bc40b90af1b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.343678:0:18856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2000/0xcb5b7bc40b90af0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad40 expref: 8 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.343695:0:18856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d3600/0xcb5b7bc40b90af22 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad40 expref: 7 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.343703:0:18856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bd04506a600) 00010000:00010000:3.0:1788836531.343705:0:18856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788836531.343713:0:18856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0413d3600, rc 0) 00000100:00100000:3.0:1788836531.343801:0:18856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95db1520-ad90-486a-963f-ce27a404b1dd+7:17394:x1875730518649344:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1289us (1628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836531.343809:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:2.0:1788836531.349246:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836531.349406:0:18855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518649600 00000100:00100000:3.0:1788836531.349421:0:18855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518649600 00000100:00100000:3.0:1788836531.349502:0:18855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:3.0:1788836531.349514:0:18855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95db1520-ad90-486a-963f-ce27a404b1dd+7:17394:x1875730518649600:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788836531.349541:0:18855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836531.349566:0:18855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2000/0xcb5b7bc40b90af29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ad47 expref: -99 pid: 18855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836531.349694:0:18855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788836531.349856:0:18855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2000/0xcb5b7bc40b90af29 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad47 expref: 9 pid: 18855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.350060:0:18855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04506a900) 00010000:00010000:3.0:1788836531.350063:0:18855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788836531.350069:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2000/0xcb5b7bc40b90af29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad47 expref: 9 pid: 18855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.350086:0:18855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0413d2000, rc 0) 00000100:00100000:2.0:1788836531.350256:0:18855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95db1520-ad90-486a-963f-ce27a404b1dd+8:17394:x1875730518649600:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 743us (1023us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1788836531.350266:0:18855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:2.0:1788836531.355414:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836531.355603:0:20076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518649856 00000100:00100000:0.0:1788836531.355617:0:20076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518649856 00000100:00100000:0.0:1788836531.355695:0:20076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:0.0:1788836531.355707:0:20076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95db1520-ad90-486a-963f-ce27a404b1dd+8:17394:x1875730518649856:12345-192.168.203.52@tcp:36:lfs.0 00010000:00010000:0.0:1788836531.355787:0:20076:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836531.355823:0:20076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d3600/0xcb5b7bc40b90af22 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad40 expref: 8 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.355847:0:20076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bd04506a600) 00010000:00010000:0.0:1788836531.355861:0:20076:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788836531.355897:0:20076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90af37 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.355912:0:20076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90af37 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.355924:0:20076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90af37 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788836531.356206:0:20076:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bafd19a0 reply state 000000004b511efc transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90af37 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836531.356219:0:20076:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788836531.356229:0:20076:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788836531.356338:0:20076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95db1520-ad90-486a-963f-ce27a404b1dd+9:17394:x1875730518649856:12345-192.168.203.52@tcp:36:lfs.0 Request processed in 633us (938us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1788836531.356413:0:20076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00010000:00010000:0.0:1788836531.360187:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90af37 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.360213:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90af37 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.360223:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90af37 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.360236:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217d800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836531.360242:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90af37 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.360251:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90af37 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.360274:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bd0498edc00) 00010000:00010000:0.0:1788836531.360277:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788836531.360283:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90af37 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.360290:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90af37 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836531.360501:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836531.360717:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518650112 00000100:00100000:0.0:1788836531.360730:0:18858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518650112 00000100:00100000:0.0:1788836531.360798:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:0.0:1788836531.360809:0:18858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95db1520-ad90-486a-963f-ce27a404b1dd+8:17394:x1875730518650112:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1788836531.361270:0:18858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95db1520-ad90-486a-963f-ce27a404b1dd+9:17394:x1875730518650112:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 461us (774us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1788836531.361277:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:1.0:1788836531.374775:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836531.376329:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518650368 00000100:00100000:0.0:1788836531.376449:0:18857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518650368 00000100:00100000:0.0:1788836531.376559:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:0.0:1788836531.376571:0:18857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07accb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95db1520-ad90-486a-963f-ce27a404b1dd+9:17394:x1875730518650368:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788836531.376604:0:18857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836531.376628:0:18857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90af3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ad4e expref: -99 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.376718:0:18857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90af45 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.376734:0:18857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90af45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.376748:0:18857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90af45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.376765:0:18857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90af4c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.376773:0:18857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90af4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.376780:0:18857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90af4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836531.377032:0:18857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788836531.377160:0:18857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90af45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.377170:0:18857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90af45 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.377195:0:18857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90af45 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.377202:0:18857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217c400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836531.377207:0:18857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90af45 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.377216:0:18857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90af45 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.377231:0:18857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04506a900) 00010000:00010000:0.0:1788836531.377235:0:18857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836531.377240:0:18857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90af45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.377247:0:18857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90af45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.377261:0:18857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90af4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.377267:0:18857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90af4c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.377272:0:18857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90af4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.377277:0:18857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217d400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836531.377280:0:18857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90af4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.377296:0:18857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90af4c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.377304:0:18857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9bd0498edc00) 00010000:00010000:0.0:1788836531.377307:0:18857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836531.377310:0:18857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90af4c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.377315:0:18857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90af4c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.377404:0:18857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90af3e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad4e expref: 11 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.377415:0:18857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04506a900) 00010000:00010000:0.0:1788836531.377418:0:18857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788836531.377421:0:18857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90af3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad4e expref: 11 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.377432:0:18857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217d800, rc 0) 00000100:00100000:0.0:1788836531.377684:0:18857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07accb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95db1520-ad90-486a-963f-ce27a404b1dd+10:17394:x1875730518650368:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1114us (2922us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1788836531.377693:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:2.0:1788836531.384520:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836531.384661:0:20076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518650496 00000100:00100000:0.0:1788836531.384675:0:20076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518650496 00000100:00100000:3.0:1788836531.384839:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:3.0:1788836531.384854:0:18856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95db1520-ad90-486a-963f-ce27a404b1dd+10:17394:x1875730518650496:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788836531.384906:0:18856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836531.384937:0:18856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2000/0xcb5b7bc40b90af5a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ad55 expref: -99 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.385077:0:18856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2a00/0xcb5b7bc40b90af61 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.385094:0:18856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2a00/0xcb5b7bc40b90af61 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.385314:0:18856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2a00/0xcb5b7bc40b90af61 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836531.386244:0:18856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788836531.386252:0:18856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788836531.386306:0:18856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2a00/0xcb5b7bc40b90af61 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836531.386373:0:18856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2000/0xcb5b7bc40b90af5a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad55 expref: 12 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836531.386469:0:18856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2a00/0xcb5b7bc40b90af61 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad55 expref: 11 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836531.386481:0:18856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bd04506a800) 00010000:00010000:2.0:1788836531.386485:0:18856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788836531.386489:0:18856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0413d2a00, rc 0) 00000100:00100000:2.0:1788836531.386704:0:18856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95db1520-ad90-486a-963f-ce27a404b1dd+11:17394:x1875730518650496:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1852us (2195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836531.386713:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:2.0:1788836531.394941:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836531.395087:0:18859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518650624 00000100:00100000:1.0:1788836531.395141:0:18859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518650624 00000100:00100000:1.0:1788836531.395216:0:18859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:1.0:1788836531.395228:0:18859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95db1520-ad90-486a-963f-ce27a404b1dd+11:17394:x1875730518650624:12345-192.168.203.52@tcp:37:lfs.0 00000100:00100000:0.0:1788836531.409088:0:18859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95db1520-ad90-486a-963f-ce27a404b1dd+11:17394:x1875730518650624:12345-192.168.203.52@tcp:37:lfs.0 Request processed in 13848us (14147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836531.409123:0:18859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:2.0:1788836531.414766:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836531.415263:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518650880 00000100:00100000:0.0:1788836531.415279:0:18858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518650880 00000100:00100000:0.0:1788836531.415472:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:0.0:1788836531.415486:0:18858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd052737c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95db1520-ad90-486a-963f-ce27a404b1dd+11:17394:x1875730518650880:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1788836531.415845:0:18858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd052737c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95db1520-ad90-486a-963f-ce27a404b1dd+12:17394:x1875730518650880:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 361us (1094us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788836531.415854:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:2.0:1788836531.477973:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836531.480222:0:18855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518651008 00000100:00100000:0.0:1788836531.480242:0:18855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518651008 00000100:00100000:0.0:1788836531.480330:0:18855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:0.0:1788836531.480363:0:18855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f148df4-92ed-4188-b862-bd6c7c089260+10:17400:x1875730518651008:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788836531.480391:0:18855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836531.480418:0:18855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90af68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ad5c expref: -99 pid: 18855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.480500:0:18855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90af6f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.480518:0:18855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90af6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.480532:0:18855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90af6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.480549:0:18855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90af76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.480556:0:18855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90af76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.480585:0:18855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90af76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.480705:0:18855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217dc00/0xcb5b7bc40b90af7d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.480715:0:18855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217dc00/0xcb5b7bc40b90af7d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.480722:0:18855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217dc00/0xcb5b7bc40b90af7d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836531.480755:0:18855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788836531.480760:0:18855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788836531.480820:0:18855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217dc00/0xcb5b7bc40b90af7d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.480837:0:18855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90af6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.480843:0:18855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90af6f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.480851:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90af6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.480858:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217d400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836531.480862:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90af6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.480871:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90af6f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.480892:0:18855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04506a900) 00010000:00010000:0.0:1788836531.480895:0:18855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836531.480902:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90af6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.480908:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90af6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.480922:0:18855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90af76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.480928:0:18855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90af76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.480933:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90af76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.480938:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217c400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836531.480941:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90af76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.480947:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90af76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.480955:0:18855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9bd0498edc00) 00010000:00010000:0.0:1788836531.480958:0:18855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836531.480961:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90af76 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.480967:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90af76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.482175:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90af68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad5c expref: 12 pid: 18855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.482193:0:18855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217dc00/0xcb5b7bc40b90af7d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad5c expref: 11 pid: 18855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.482201:0:18855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bd04506a800) 00010000:00010000:0.0:1788836531.482204:0:18855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788836531.482207:0:18855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217dc00, rc 0) 00000100:00100000:0.0:1788836531.482309:0:18855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f148df4-92ed-4188-b862-bd6c7c089260+11:17400:x1875730518651008:12345-192.168.203.52@tcp:101:bash.0 Request processed in 1968us (4349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836531.482318:0:18855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:2.0:1788836531.488137:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836531.488305:0:20076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518651264 00000100:00100000:1.0:1788836531.488318:0:20076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518651264 00000100:00100000:1.0:1788836531.488435:0:20076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:1.0:1788836531.488447:0:20076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f148df4-92ed-4188-b862-bd6c7c089260+11:17400:x1875730518651264:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1788836531.488477:0:20076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836531.488517:0:20076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4a00/0xcb5b7bc40b90af84 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ad63 expref: -99 pid: 20076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.488677:0:20076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5e00/0xcb5b7bc40b90af8b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.488695:0:20076:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2a00/0xcb5b7bc40b90af61 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad55 expref: 11 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.488705:0:20076:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5e00/0xcb5b7bc40b90af8b lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.488749:0:20076:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2a00/0xcb5b7bc40b90af61 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad55 expref: 11 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.488783:0:20076:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2a00/0xcb5b7bc40b90af61 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad55 expref: 11 pid: 18856 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836531.488804:0:20076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20076:1875730538563328:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788836531.488925:0:20076:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046707cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836531.502563:0:20076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20076:1875730538563328:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788836531.502607:0:20076:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5e00/0xcb5b7bc40b90af8b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836531.506632:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836531.506856:0:18840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518651392 00000100:00100000:0.0:1788836531.506871:0:18840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518651392 00010000:00010000:0.0:1788836531.506927:0:18840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2a00/0xcb5b7bc40b90af61 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad55 expref: 12 pid: 18856 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836531.506982:0:18840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:0.0:1788836531.506994:0:18840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:95db1520-ad90-486a-963f-ce27a404b1dd+12:2353:x1875730518651392:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836531.507084:0:18840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836531.507093:0:18840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2a00/0xcb5b7bc40b90af61 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad55 expref: 12 pid: 18856 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.507120:0:18840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2a00/0xcb5b7bc40b90af61 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad55 expref: 12 pid: 18856 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.507174:0:18840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0413d2a00/0xcb5b7bc40b90af61 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad55 expref: 12 pid: 18856 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.507196:0:18840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bd04506a800) 00010000:00010000:0.0:1788836531.507203:0:18840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5e00/0xcb5b7bc40b90af8b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.507214:0:18840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5e00/0xcb5b7bc40b90af8b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.507222:0:18840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5e00/0xcb5b7bc40b90af8b lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.507262:0:18840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836531.507332:0:18840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:95db1520-ad90-486a-963f-ce27a404b1dd+11:2353:x1875730518651392:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 340us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836531.507408:0:18840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00010000:00010000:1.0:1788836531.507570:0:20076:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5e00/0xcb5b7bc40b90af8b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.507580:0:20076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5e00/0xcb5b7bc40b90af8b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.507613:0:20076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4000/0xcb5b7bc40b90af92 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.507625:0:20076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4000/0xcb5b7bc40b90af92 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.507634:0:20076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4000/0xcb5b7bc40b90af92 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.515937:0:20076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5800/0xcb5b7bc40b90af99 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.515967:0:20076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5800/0xcb5b7bc40b90af99 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.516126:0:20076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5800/0xcb5b7bc40b90af99 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836531.516143:0:20076:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788836531.516183:0:20076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5e00/0xcb5b7bc40b90af8b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.516191:0:20076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5e00/0xcb5b7bc40b90af8b lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.516199:0:20076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5e00/0xcb5b7bc40b90af8b lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.516205:0:20076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bcf44ab5e00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836531.516210:0:20076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5e00/0xcb5b7bc40b90af8b lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.516217:0:20076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5e00/0xcb5b7bc40b90af8b lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.516233:0:20076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bd04506a800) 00010000:00010000:1.0:1788836531.516237:0:20076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836531.516242:0:20076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5e00/0xcb5b7bc40b90af8b lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.516249:0:20076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5e00/0xcb5b7bc40b90af8b lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788836531.516266:0:20076:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000093c55608 reply state 000000005b9e843e transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4000/0xcb5b7bc40b90af92 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836531.516287:0:20076:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788836531.516337:0:20076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4a00/0xcb5b7bc40b90af84 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad63 expref: 14 pid: 20076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.516870:0:20076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5800/0xcb5b7bc40b90af99 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad63 expref: 13 pid: 20076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.516879:0:20076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd0514d4600) 00010000:00010000:1.0:1788836531.516882:0:20076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788836531.516885:0:20076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bcf44ab5800, rc 0) 00000100:00100000:1.0:1788836531.517048:0:20076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f148df4-92ed-4188-b862-bd6c7c089260+14:17400:x1875730518651264:12345-192.168.203.52@tcp:101:bash.0 Request processed in 28603us (28926us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1788836531.517060:0:20076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 28 00010000:00010000:3.0:1788836531.522890:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4000/0xcb5b7bc40b90af92 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.522914:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4000/0xcb5b7bc40b90af92 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.522923:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4000/0xcb5b7bc40b90af92 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.522930:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bcf44ab4000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836531.522935:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4000/0xcb5b7bc40b90af92 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.522945:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4000/0xcb5b7bc40b90af92 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.522967:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9bd0514d4f00) 00010000:00010000:3.0:1788836531.522970:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836531.522976:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4000/0xcb5b7bc40b90af92 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.522983:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4000/0xcb5b7bc40b90af92 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836531.538335:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836531.538471:0:18855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518651520 00000100:00100000:0.0:1788836531.538491:0:18855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518651520 00000100:00100000:0.0:1788836531.539975:0:18855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:0.0:1788836531.540006:0:18855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f148df4-92ed-4188-b862-bd6c7c089260+13:17400:x1875730518651520:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788836531.540040:0:18855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836531.540067:0:18855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90afa7 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ad6a expref: -99 pid: 18855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.540170:0:18855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90afae lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.540209:0:18855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90afae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.540223:0:18855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90afae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836531.540278:0:18855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788836531.540283:0:18855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788836531.540308:0:18855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90afae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.540320:0:18855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90afae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.540397:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90afa7 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad6a expref: 15 pid: 18855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.540433:0:18855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90afae lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad6a expref: 14 pid: 18855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.540443:0:18855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd0514d4600) 00010000:00010000:0.0:1788836531.540446:0:18855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788836531.540451:0:18855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217c400, rc 0) 00000100:00100000:0.0:1788836531.541169:0:18855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f148df4-92ed-4188-b862-bd6c7c089260+14:17400:x1875730518651520:12345-192.168.203.52@tcp:101:bash.0 Request processed in 1176us (2841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836531.541179:0:18855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:2.0:1788836531.553132:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836531.553303:0:18859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518651776 00000100:00100000:1.0:1788836531.553317:0:18859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518651776 00000100:00100000:1.0:1788836531.553431:0:18859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:1.0:1788836531.553443:0:18859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9f148df4-92ed-4188-b862-bd6c7c089260+14:17400:x1875730518651776:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:1.0:1788836531.554160:0:18859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9f148df4-92ed-4188-b862-bd6c7c089260+15:17400:x1875730518651776:12345-192.168.203.52@tcp:35:bash.0 Request processed in 714us (1036us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1788836531.554170:0:18859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000040:00080000:3.0:1788836531.666614:0:18889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788836531.696409:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836531.696549:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518652032 00000100:00100000:0.0:1788836531.696561:0:18856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518652032 00000100:00100000:0.0:1788836531.696634:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:0.0:1788836531.696655:0:18856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f148df4-92ed-4188-b862-bd6c7c089260+15:17410:x1875730518652032:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788836531.697837:0:18856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836531.697875:0:18856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90afb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ad71 expref: -99 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836531.697998:0:18856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788836531.698869:0:18856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90afb5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad71 expref: 17 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.698889:0:18856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04506a900) 00010000:00010000:0.0:1788836531.698893:0:18856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788836531.698899:0:18856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90afb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad71 expref: 17 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.698915:0:18856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217d800, rc 0) 00000100:00100000:0.0:1788836531.699004:0:18856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f148df4-92ed-4188-b862-bd6c7c089260+16:17410:x1875730518652032:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 2352us (2609us total) trans 12884901898 rc 301/301 00000100:00100000:0.0:1788836531.699016:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:3.0:1788836531.710165:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836531.710698:0:18859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518652288 00000100:00100000:1.0:1788836531.710708:0:18859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518652288 00000100:00100000:1.0:1788836531.710769:0:18859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:1.0:1788836531.710779:0:18859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9f148df4-92ed-4188-b862-bd6c7c089260+16:17410:x1875730518652288:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1788836531.711119:0:18859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9f148df4-92ed-4188-b862-bd6c7c089260+17:17410:x1875730518652288:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 340us (962us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1788836531.711141:0:18859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:1.0:1788836531.758950:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836531.759307:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518652544 00000100:00100000:0.0:1788836531.759318:0:18857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518652544 00000100:00100000:0.0:1788836531.759424:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:0.0:1788836531.759434:0:18857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f148df4-92ed-4188-b862-bd6c7c089260+17:17413:x1875730518652544:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788836531.759457:0:18857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836531.759477:0:18857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90afc3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ad78 expref: -99 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.759571:0:18857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90afca lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.759609:0:18857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90afca lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.759621:0:18857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90afca lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836531.759635:0:18857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788836531.759775:0:18857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90afc3 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad78 expref: 20 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.759796:0:18857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90afca lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad78 expref: 19 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836531.759806:0:18857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd0514d4600) 00010000:00010000:0.0:1788836531.759809:0:18857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788836531.759813:0:18857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217c200, rc 0) 00000100:00100000:0.0:1788836531.759879:0:18857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f148df4-92ed-4188-b862-bd6c7c089260+19:17413:x1875730518652544:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 445us (938us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1788836531.759886:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:0.0:1788836531.769457:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836531.769845:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836531.770257:0:18841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518652800 00000100:00100000:2.0:1788836531.770271:0:18841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518652800 00000100:00100000:2.0:1788836531.770377:0:18841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:2.0:1788836531.770388:0:18841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a359180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9f148df4-92ed-4188-b862-bd6c7c089260+19:2356:x1875730518652800:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836531.770416:0:18841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836531.770442:0:18841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90afca lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad78 expref: 19 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836531.770463:0:18841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd0514d4600) 00010000:00010000:2.0:1788836531.770467:0:18841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836531.770519:0:18841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a359180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9f148df4-92ed-4188-b862-bd6c7c089260+18:2356:x1875730518652800:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 133us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836531.770527:0:18841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:1.0:1788836531.771249:0:20076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518652672 00000100:00100000:1.0:1788836531.771257:0:20076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518652672 00000100:00100000:1.0:1788836531.771304:0:20076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:1.0:1788836531.771312:0:20076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f148df4-92ed-4188-b862-bd6c7c089260+18:17413:x1875730518652672:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:1.0:1788836531.771418:0:20076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5400/0xcb5b7bc40b90afd8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.771435:0:20076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5400/0xcb5b7bc40b90afd8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.771446:0:20076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5400/0xcb5b7bc40b90afd8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.771474:0:20076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5400/0xcb5b7bc40b90afd8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.771480:0:20076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5400/0xcb5b7bc40b90afd8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.771487:0:20076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5400/0xcb5b7bc40b90afd8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.771493:0:20076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bcf44ab5400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836531.771497:0:20076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5400/0xcb5b7bc40b90afd8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.771516:0:20076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5400/0xcb5b7bc40b90afd8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.771545:0:20076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd0514d4600) 00010000:00010000:1.0:1788836531.771548:0:20076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788836531.771553:0:20076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5400/0xcb5b7bc40b90afd8 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836531.771559:0:20076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5400/0xcb5b7bc40b90afd8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836531.771618:0:20076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f148df4-92ed-4188-b862-bd6c7c089260+18:17413:x1875730518652672:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 305us (2169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836531.771625:0:20076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:0.0:1788836531.778316:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836531.780149:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518653056 00000100:00100000:1.0:1788836531.780163:0:18858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518653056 00000100:00100000:1.0:1788836531.780239:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:1.0:1788836531.780250:0:18858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9f148df4-92ed-4188-b862-bd6c7c089260+18:17413:x1875730518653056:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1788836531.780558:0:18858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9f148df4-92ed-4188-b862-bd6c7c089260+19:17413:x1875730518653056:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 310us (2250us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1788836531.780566:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:2.0:1788836531.783075:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836531.783730:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518653184 00000100:00100000:3.0:1788836531.783741:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518653184 00000100:00100000:3.0:1788836531.783803:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 113 00000100:00100000:3.0:1788836531.783811:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:462ae43d-104f-4dae-9208-57a489fa1d04+11:16768:x1875730518653184:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836531.783827:0:18850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836531.783847:0:18850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd0413d2a00/0xcb5b7bc40b90afdf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb59b48549316ad7f expref: -99 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.783885:0:18850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd0413d2a00/0xcb5b7bc40b90afdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad7f expref: 12 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.783897:0:18850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd0413d2a00/0xcb5b7bc40b90afdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad7f expref: 12 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.783906:0:18850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0413d2a00, rc 0) 00000100:00100000:3.0:1788836531.783975:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:462ae43d-104f-4dae-9208-57a489fa1d04+12:16768:x1875730518653184:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 163us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836531.783982:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 113 00000100:00100000:3.0:1788836531.793604:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836531.794658:0:18847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518653312 00000100:00100000:2.0:1788836531.794670:0:18847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518653312 00000100:00100000:2.0:1788836531.794728:0:18847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 114 00000100:00100000:2.0:1788836531.794739:0:18847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44940c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:462ae43d-104f-4dae-9208-57a489fa1d04+12:16768:x1875730518653312:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836531.795062:0:18847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44940c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:462ae43d-104f-4dae-9208-57a489fa1d04+12:16768:x1875730518653312:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 324us (1467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836531.795072:0:18847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 114 00000100:00100000:1.0:1788836531.803579:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836531.804159:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518653440 00000100:00100000:0.0:1788836531.804169:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518653440 00000100:00100000:0.0:1788836531.804231:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 115 00000100:00100000:0.0:1788836531.804253:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44942850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:462ae43d-104f-4dae-9208-57a489fa1d04+12:16768:x1875730518653440:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836531.804814:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44942850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:462ae43d-104f-4dae-9208-57a489fa1d04+12:16768:x1875730518653440:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 572us (1251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836531.804834:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 115 00000100:00100000:0.0:1788836531.814532:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836531.814706:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518653568 00000100:00100000:3.0:1788836531.814716:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518653568 00000100:00100000:3.0:1788836531.814841:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 116 00000100:00100000:3.0:1788836531.814853:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44940450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:462ae43d-104f-4dae-9208-57a489fa1d04+12:16768:x1875730518653568:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836531.814909:0:18850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836531.814927:0:18850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd0413d3a00/0xcb5b7bc40b90afe6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb59b48549316ad86 expref: -99 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.814956:0:18850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd0413d3a00/0xcb5b7bc40b90afe6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad86 expref: 13 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.814968:0:18850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd0413d3a00/0xcb5b7bc40b90afe6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad86 expref: 13 pid: 18850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836531.814977:0:18850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0413d3a00, rc 0) 00000100:00100000:3.0:1788836531.815037:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44940450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:462ae43d-104f-4dae-9208-57a489fa1d04+13:16768:x1875730518653568:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 187us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836531.815044:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 116 00000100:00100000:3.0:1788836531.816808:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836531.817751:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518653696 00000100:00100000:0.0:1788836531.817764:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518653696 00000100:00100000:0.0:1788836531.817836:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 117 00000100:00100000:0.0:1788836531.817847:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44941050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:462ae43d-104f-4dae-9208-57a489fa1d04+13:16768:x1875730518653696:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836531.818620:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44941050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:462ae43d-104f-4dae-9208-57a489fa1d04+13:16768:x1875730518653696:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 771us (1813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836531.818641:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 117 00000100:00100000:1.0:1788836531.825218:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836531.825323:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518653824 00000100:00100000:3.0:1788836531.825333:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518653824 00000100:00100000:3.0:1788836531.825467:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 118 00000100:00100000:3.0:1788836531.825477:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44940050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:462ae43d-104f-4dae-9208-57a489fa1d04+13:16768:x1875730518653824:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788836531.825687:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44940050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:462ae43d-104f-4dae-9208-57a489fa1d04+13:16768:x1875730518653824:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 211us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836531.825695:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 118 00000100:00100000:2.0:1788836532.083308:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836532.083442:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518654080 00000100:00100000:0.0:1788836532.083451:0:18857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518654080 00000100:00100000:0.0:1788836532.083511:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:0.0:1788836532.083521:0:18857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f148df4-92ed-4188-b862-bd6c7c089260+19:17446:x1875730518654080:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:0.0:1788836532.083546:0:18857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836532.083578:0:18857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90afed lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ad8d expref: -99 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.083695:0:18857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90aff4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.083709:0:18857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90aff4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.083723:0:18857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90aff4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836532.083733:0:18857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788836532.083892:0:18857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90afed lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad8d expref: 22 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.083912:0:18857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90aff4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad8d expref: 21 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.083921:0:18857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd0514d4600) 00010000:00010000:0.0:1788836532.083923:0:18857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788836532.083927:0:18857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217d600, rc 0) 00000100:00100000:0.0:1788836532.083993:0:18857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f148df4-92ed-4188-b862-bd6c7c089260+21:17446:x1875730518654080:12345-192.168.203.52@tcp:101:cat.0 Request processed in 473us (695us total) trans 12884901902 rc 0/0 00000100:00100000:0.0:1788836532.084001:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:0.0:1788836532.088277:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836532.088323:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836532.088423:0:18840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518654208 00000100:00100000:2.0:1788836532.088434:0:18840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518654208 00000100:00100000:2.0:1788836532.088500:0:18840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:2.0:1788836532.088510:0:18840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f148df4-92ed-4188-b862-bd6c7c089260+21:2355:x1875730518654208:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836532.088543:0:18840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836532.088584:0:18840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90aff4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad8d expref: 21 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836532.088602:0:18840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd0514d4600) 00010000:00010000:2.0:1788836532.088607:0:18840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836532.088661:0:18840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f148df4-92ed-4188-b862-bd6c7c089260+20:2355:x1875730518654208:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 151us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836532.088667:0:18840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:1.0:1788836532.089737:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518654464 00000100:00100000:1.0:1788836532.089746:0:18858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518654464 00000100:00100000:1.0:1788836532.089791:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:1.0:1788836532.089800:0:18858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9f148df4-92ed-4188-b862-bd6c7c089260+20:17446:x1875730518654464:12345-192.168.203.52@tcp:35:cat.0 00000100:00100000:1.0:1788836532.090327:0:18858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9f148df4-92ed-4188-b862-bd6c7c089260+21:17446:x1875730518654464:12345-192.168.203.52@tcp:35:cat.0 Request processed in 526us (2001us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1788836532.090376:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00010000:00010000:2.0:1788836532.112559:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836532.128890:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836532.128989:0:20076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518654720 00000100:00100000:1.0:1788836532.128998:0:20076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518654720 00000100:00100000:1.0:1788836532.129058:0:20076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:1.0:1788836532.129068:0:20076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f148df4-92ed-4188-b862-bd6c7c089260+21:17452:x1875730518654720:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:1.0:1788836532.129093:0:20076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836532.129123:0:20076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4600/0xcb5b7bc40b90b002 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ad94 expref: -99 pid: 20076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.129221:0:20076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4e00/0xcb5b7bc40b90b009 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.129236:0:20076:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5800/0xcb5b7bc40b90af99 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad63 expref: 22 pid: 20076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.129245:0:20076:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90afae lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad6a expref: 22 pid: 18855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.129254:0:20076:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4e00/0xcb5b7bc40b90b009 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.129288:0:20076:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90afae lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad6a expref: 22 pid: 18855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.129305:0:20076:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90afae lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad6a expref: 22 pid: 18855 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836532.129319:0:20076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acca300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20076:1875730538563456:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788836532.129480:0:20076:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5800/0xcb5b7bc40b90af99 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad63 expref: 22 pid: 20076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.129490:0:20076:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5800/0xcb5b7bc40b90af99 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad63 expref: 22 pid: 20076 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836532.129499:0:20076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07accbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20076:1875730538563584:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788836532.129524:0:20076:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046707600 going to sleep for 11 seconds 00000100:00100000:2.0:1788836532.140556:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836532.140695:0:20076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acca300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20076:1875730538563456:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788836532.140710:0:20076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07accbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20076:1875730538563584:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788836532.140735:0:20076:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4e00/0xcb5b7bc40b90b009 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836532.140811:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836532.142746:0:18842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518654848 00000100:00100000:3.0:1788836532.142761:0:18842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518654848 00010000:00010000:3.0:1788836532.142806:0:18842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90afae lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad6a expref: 23 pid: 18855 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836532.143120:0:18842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518654976 00000100:00100000:3.0:1788836532.143125:0:18842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518654976 00010000:00010000:3.0:1788836532.143142:0:18842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5800/0xcb5b7bc40b90af99 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad63 expref: 24 pid: 20076 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836532.143183:0:18841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:2.0:1788836532.143196:0:18841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44af1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9f148df4-92ed-4188-b862-bd6c7c089260+24:2353:x1875730518654848:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836532.143215:0:18841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836532.143222:0:18841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90afae lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad6a expref: 24 pid: 18855 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836532.143236:0:18841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90afae lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad6a expref: 24 pid: 18855 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836532.143259:0:18841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90afae lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad6a expref: 24 pid: 18855 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836532.143275:0:18841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd0514d4600) 00010000:00010000:2.0:1788836532.143280:0:18841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4e00/0xcb5b7bc40b90b009 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836532.143294:0:18841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4e00/0xcb5b7bc40b90b009 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836532.143301:0:18841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836532.143402:0:18841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44af1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9f148df4-92ed-4188-b862-bd6c7c089260+23:2353:x1875730518654848:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 208us (2855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836532.143410:0:18841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:2.0:1788836532.143460:0:18841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:2.0:1788836532.143467:0:18841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9f148df4-92ed-4188-b862-bd6c7c089260+22:2353:x1875730518654976:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836532.143476:0:18841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836532.143482:0:18841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5800/0xcb5b7bc40b90af99 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad63 expref: 22 pid: 20076 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836532.143491:0:18841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5800/0xcb5b7bc40b90af99 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad63 expref: 22 pid: 20076 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836532.143503:0:18841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5800/0xcb5b7bc40b90af99 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad63 expref: 22 pid: 20076 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836532.143512:0:18841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd0514d4600) 00010000:00010000:2.0:1788836532.143516:0:18841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4e00/0xcb5b7bc40b90b009 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836532.143523:0:18841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4e00/0xcb5b7bc40b90b009 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836532.143531:0:18841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4e00/0xcb5b7bc40b90b009 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836532.143569:0:18841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836532.143590:0:18841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9f148df4-92ed-4188-b862-bd6c7c089260+21:2353:x1875730518654976:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 123us (2780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836532.143596:0:18841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00010000:00010000:0.0:1788836532.143901:0:20076:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4e00/0xcb5b7bc40b90b009 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.143909:0:20076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4e00/0xcb5b7bc40b90b009 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836532.143928:0:20076:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788836532.144099:0:20076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4600/0xcb5b7bc40b90b002 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad94 expref: 22 pid: 20076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.144126:0:20076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4e00/0xcb5b7bc40b90b009 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad94 expref: 21 pid: 20076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.144138:0:20076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd0514d4600) 00010000:00010000:0.0:1788836532.144148:0:20076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788836532.144151:0:20076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bcf44ab4e00, rc 0) 00000100:00100000:0.0:1788836532.144180:0:20076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f148df4-92ed-4188-b862-bd6c7c089260+21:17452:x1875730518654720:12345-192.168.203.52@tcp:101:dd.0 Request processed in 15113us (15300us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1788836532.144186:0:20076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:2.0:1788836532.147608:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836532.147717:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518655232 00000100:00100000:0.0:1788836532.147727:0:18857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518655232 00000100:00100000:0.0:1788836532.147808:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:0.0:1788836532.147819:0:18857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f148df4-92ed-4188-b862-bd6c7c089260+21:17452:x1875730518655232:12345-192.168.203.52@tcp:36:dd.0 00010000:00010000:0.0:1788836532.148311:0:18857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90b017 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.148328:0:18857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90b017 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.148339:0:18857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90b017 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788836532.148431:0:18857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:0.0:1788836532.148458:0:18857:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c3b7899 reply state 0000000027c47492 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90b017 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836532.148467:0:18857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788836532.148565:0:18857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f148df4-92ed-4188-b862-bd6c7c089260+24:17452:x1875730518655232:12345-192.168.203.52@tcp:36:dd.0 Request processed in 747us (966us total) trans 12884901906 rc 0/0 00000100:00100000:0.0:1788836532.148573:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 35 00000020:00080000:0.0:1788836532.148578:0:18857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788836532.150428:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90b017 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836532.150444:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90b017 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836532.150452:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90b017 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836532.150457:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217d800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836532.150461:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90b017 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836532.150469:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90b017 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836532.150485:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd0514d4600) 00010000:00010000:3.0:1788836532.150488:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836532.150493:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90b017 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836532.150499:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90b017 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836532.152648:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836532.152810:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518655360 00000100:00100000:0.0:1788836532.152819:0:18856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518655360 00000100:00100000:0.0:1788836532.152884:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:0.0:1788836532.152910:0:18856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f148df4-92ed-4188-b862-bd6c7c089260+23:17452:x1875730518655360:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:0.0:1788836532.152933:0:18856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836532.152952:0:18856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90b01e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ad9b expref: -99 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.153011:0:18856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90b01e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad9b expref: 24 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.153036:0:18856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90b01e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad9b expref: 24 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.153057:0:18856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd0514d4600) 00010000:00010000:0.0:1788836532.153060:0:18856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788836532.153063:0:18856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217c400, rc 0) 00000100:00100000:0.0:1788836532.153130:0:18856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f148df4-92ed-4188-b862-bd6c7c089260+24:17452:x1875730518655360:12345-192.168.203.52@tcp:101:dd.0 Request processed in 221us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836532.153137:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:2.0:1788836532.164120:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836532.164224:0:18840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518655616 00000100:00100000:0.0:1788836532.164234:0:18840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518655616 00000100:00100000:0.0:1788836532.164295:0:18840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:0.0:1788836532.164306:0:18840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f148df4-92ed-4188-b862-bd6c7c089260+24:17452:x1875730518655616:12345-192.168.203.52@tcp:103:dd.0 00010000:00010000:0.0:1788836532.164321:0:18840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836532.164388:0:18840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90b01e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ad9b expref: 24 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.164407:0:18840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd0514d4600) 00010000:00010000:0.0:1788836532.164412:0:18840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836532.164487:0:18840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f148df4-92ed-4188-b862-bd6c7c089260+23:17452:x1875730518655616:12345-192.168.203.52@tcp:103:dd.0 Request processed in 183us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836532.164496:0:18840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:2.0:1788836532.167243:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836532.167325:0:18855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518655744 00000100:00100000:0.0:1788836532.167335:0:18855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518655744 00000100:00100000:0.0:1788836532.167418:0:18855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:0.0:1788836532.167427:0:18855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f148df4-92ed-4188-b862-bd6c7c089260+23:17452:x1875730518655744:12345-192.168.203.52@tcp:58:dd.0 00010000:00010000:0.0:1788836532.167516:0:18855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90b025 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.167533:0:18855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90b025 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.167545:0:18855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90b025 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788836532.169837:0:18855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788836532.170235:0:18855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1788836532.170306:0:18855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1788836532.170593:0:18855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f148df4-92ed-4188-b862-bd6c7c089260+23:17452:x1875730518655744:12345-192.168.203.52@tcp:58:dd.0 Request processed in 3161us (3353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836532.170603:0:18855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:3.0:1788836532.173191:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836532.173391:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518655872 00000100:00100000:0.0:1788836532.173409:0:18856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518655872 00000100:00100000:0.0:1788836532.173467:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:0.0:1788836532.173477:0:18856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f148df4-92ed-4188-b862-bd6c7c089260+23:17452:x1875730518655872:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:0.0:1788836532.173496:0:18856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836532.173515:0:18856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90b02c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ada2 expref: -99 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.173582:0:18856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90b025 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.173592:0:18856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90b02c lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ada2 expref: 24 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.173611:0:18856:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90b025 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.173624:0:18856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90b02c lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ada2 expref: 24 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.173637:0:18856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd0514d4600) 00010000:00010000:0.0:1788836532.173640:0:18856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788836532.173644:0:18856:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90b02c lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ada2 expref: 24 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.173651:0:18856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217c400, rc 0) 00000100:00100000:0.0:1788836532.173711:0:18856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f148df4-92ed-4188-b862-bd6c7c089260+24:17452:x1875730518655872:12345-192.168.203.52@tcp:101:dd.0 Request processed in 235us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836532.173718:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:1.0:1788836532.562432:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538563840:0@lo:400:kworker.0 00000100:00100000:1.0:1788836532.562501:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836532.562558:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538564352:0@lo:400:kworker.0 00000100:00100000:1.0:1788836532.562582:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836532.562605:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836532.562610:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538563968:0@lo:400:kworker.0 00000100:00100000:1.0:1788836532.562629:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836532.562661:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538564352 00000100:00100000:1.0:1788836532.562668:0:18857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538564352 00000100:00100000:1.0:1788836532.562715:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788836532.562723:0:18857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07accb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875730538564352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836532.562769:0:18857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07accb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875730538564352:12345-0@lo:400:kworker.0 Request processed in 47us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836532.562790:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788836532.562836:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538564352:0@lo:400:kworker.0 00000100:00100000:1.0:1788836532.562879:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538563840 00000100:00100000:0.0:1788836532.562880:0:19539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538563968 00000100:00100000:1.0:1788836532.562883:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538563840 00000100:00100000:0.0:1788836532.562883:0:19539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538563968 00000100:00100000:2.0:1788836532.562941:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07accbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc96480a-9861-42d8-abb0-6f65502ae376:3305:1875730538563712:0@lo:400:kworker.0 00000100:00100000:3.0:1788836532.562970:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538564480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788836532.562975:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836532.562997:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836532.563304:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07accaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875730538564224:0@lo:400:kworker.0 00000100:00100000:2.0:1788836532.563333:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836532.563379:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788836532.563385:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07accad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875730538564096:0@lo:400:kworker.0 00000100:00100000:2.0:1788836532.563405:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836532.563443:0:19543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538564480 00000100:00100000:2.0:1788836532.563447:0:19543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538564480 00000100:00100000:2.0:1788836532.563474:0:19543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788836532.563480:0:19543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875730538564480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788836532.563510:0:19543:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788836532.563539:0:19543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875730538564480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836532.563545:0:19543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788836532.565093:0:19539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788836532.565124:0:19539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538563840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836532.565195:0:19539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538563840:12345-0@lo:400:kworker.0 Request processed in 78us (2693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836532.565214:0:19539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788836532.565237:0:19539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788836532.565244:0:19539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf46d90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538563968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836532.565275:0:19539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf46d90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538563968:12345-0@lo:400:kworker.0 Request processed in 32us (2645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836532.565280:0:19539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788836532.565340:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538563968:0@lo:400:kworker.0 00000100:00100000:0.0:1788836532.565371:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538563840:0@lo:400:kworker.0 00000100:00100000:0.0:1788836532.565403:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538564224 00000100:00100000:0.0:1788836532.565408:0:18856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538564224 00000100:00080000:2.0:1788836532.565409:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788836532.565413:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788836532.565422:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836532.565434:0:18849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538563712 00000100:00100000:0.0:1788836532.565437:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538564096 00000100:00100000:2.0:1788836532.565438:0:18849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538563712 00000100:00100000:0.0:1788836532.565439:0:18856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538564096 00000100:00100000:0.0:1788836532.565451:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788836532.565456:0:18856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875730538564224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836532.565461:0:18849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788836532.565467:0:18849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+19:3305:x1875730538563712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836532.565494:0:18856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875730538564224:12345-0@lo:400:kworker.0 Request processed in 37us (2160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836532.565495:0:18849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc96480a-9861-42d8-abb0-6f65502ae376+19:3305:x1875730538563712:12345-0@lo:400:kworker.0 Request processed in 29us (2520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836532.565500:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788836532.565501:0:18849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788836532.565524:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07accbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc96480a-9861-42d8-abb0-6f65502ae376:3305:1875730538563712:0@lo:400:kworker.0 00000100:00100000:2.0:1788836532.565534:0:18855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788836532.565536:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07accaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875730538564224:0@lo:400:kworker.0 00000100:00100000:2.0:1788836532.565540:0:18855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875730538564096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836532.565577:0:18855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875730538564096:12345-0@lo:400:kworker.0 Request processed in 37us (2170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836532.565584:0:18855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788836532.565593:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07accad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875730538564096:0@lo:400:kworker.0 00000100:00100000:3.0:1788836532.565709:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538564480:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1788836532.688559:0:18889:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788836532.688568:0:18889:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788836532.688603:0:18889:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788836532.688610:0:18889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788836532.688725:0:18889:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a359500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18889:1875730538564608:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788836532.688839:0:18889:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046706900 going to sleep for 11 seconds 00000100:00100000:3.0:1788836532.698018:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836532.698166:0:18889:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a359500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18889:1875730538564608:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788836532.698189:0:18866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518656000 00000100:00100000:1.0:1788836532.698197:0:18866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518656000 00000100:00100000:1.0:1788836532.698259:0:18866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:1.0:1788836532.698271:0:18866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9f148df4-92ed-4188-b862-bd6c7c089260+24:17453:x1875730518656000:12345-192.168.203.52@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788836532.698403:0:18866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9f148df4-92ed-4188-b862-bd6c7c089260+24:17453:x1875730518656000:12345-192.168.203.52@tcp:900:lhsmtool_posix.0 Request processed in 135us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836532.698412:0:18866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:2.0:1788836532.703915:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836532.704006:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518656128 00000100:00100000:0.0:1788836532.704015:0:18857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518656128 00000100:00100000:0.0:1788836532.704082:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:0.0:1788836532.704092:0:18857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f148df4-92ed-4188-b862-bd6c7c089260+24:17453:x1875730518656128:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788836532.704133:0:18857:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788836532.704235:0:18857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f148df4-92ed-4188-b862-bd6c7c089260+24:17453:x1875730518656128:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 144us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836532.704246:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:2.0:1788836532.708646:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836532.708739:0:18855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518656256 00000100:00100000:0.0:1788836532.708748:0:18855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518656256 00000100:00100000:0.0:1788836532.708801:0:18855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:0.0:1788836532.708810:0:18855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f148df4-92ed-4188-b862-bd6c7c089260+24:17453:x1875730518656256:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788836532.708900:0:18855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90b033 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.708917:0:18855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90b033 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.708928:0:18855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90b033 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.708942:0:18855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b03a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.708949:0:18855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b03a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.708955:0:18855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b03a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.708976:0:18855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b041 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.709000:0:18855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b041 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.709007:0:18855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b041 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836532.709044:0:18855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788836532.709048:0:18855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788836532.709061:0:18855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b041 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.709072:0:18855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90b033 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.709078:0:18855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90b033 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.709084:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90b033 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.709090:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217c000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836532.709095:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90b033 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.709117:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90b033 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.709130:0:18855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd04506ac00) 00010000:00010000:0.0:1788836532.709133:0:18855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836532.709138:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90b033 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.709153:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90b033 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.709168:0:18855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b03a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.709174:0:18855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b03a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.709180:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b03a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.709185:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217d400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836532.709188:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b03a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.709194:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b03a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.709202:0:18855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9bd0498edc00) 00010000:00010000:0.0:1788836532.709205:0:18855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836532.709207:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b03a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.709213:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b03a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.709226:0:18855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b041 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.709232:0:18855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b041 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.709245:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b041 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.709250:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217c200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836532.709253:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b041 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.709260:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b041 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.709268:0:18855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd0514d4600) 00010000:00010000:0.0:1788836532.709270:0:18855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836532.709273:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b041 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.709279:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b041 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836532.709432:0:18855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f148df4-92ed-4188-b862-bd6c7c089260+24:17453:x1875730518656256:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 Request processed in 621us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836532.709440:0:18855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:3.0:1788836532.715373:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836532.717168:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518656512 00000100:00100000:0.0:1788836532.717182:0:18857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518656512 00000100:00100000:0.0:1788836532.717254:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:0.0:1788836532.717264:0:18857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f148df4-92ed-4188-b862-bd6c7c089260+24:17453:x1875730518656512:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788836532.717286:0:18857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836532.717307:0:18857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b048 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ada9 expref: -99 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.717971:0:18857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b04f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.717986:0:18857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b04f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.717997:0:18857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b04f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836532.718008:0:18857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788836532.718119:0:18857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b04f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.718126:0:18857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b04f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.718133:0:18857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b04f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.718139:0:18857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217d400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836532.718143:0:18857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b04f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.718151:0:18857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b04f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.718163:0:18857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd0514d4600) 00010000:00010000:0.0:1788836532.718166:0:18857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788836532.718170:0:18857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b04f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.718188:0:18857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b04f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.718230:0:18857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b048 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ada9 expref: 26 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.718241:0:18857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd04506ac00) 00010000:00010000:0.0:1788836532.718243:0:18857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788836532.718248:0:18857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b048 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ada9 expref: 26 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.718257:0:18857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217c200, rc 0) 00000100:00100000:0.0:1788836532.718410:0:18857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f148df4-92ed-4188-b862-bd6c7c089260+25:17453:x1875730518656512:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 1147us (3082us total) trans 12884901907 rc 301/301 00000100:00100000:0.0:1788836532.718418:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:2.0:1788836532.726109:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836532.726208:0:18855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518656640 00000100:00100000:0.0:1788836532.726218:0:18855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518656640 00000100:00100000:0.0:1788836532.726275:0:18855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:0.0:1788836532.726284:0:18855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f148df4-92ed-4188-b862-bd6c7c089260+25:17453:x1875730518656640:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788836532.726337:0:18855:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788836532.726484:0:18855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f148df4-92ed-4188-b862-bd6c7c089260+25:17453:x1875730518656640:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 200us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836532.726492:0:18855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:2.0:1788836532.729085:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836532.730751:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518656896 00000100:00100000:0.0:1788836532.730764:0:18856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518656896 00000100:00100000:0.0:1788836532.730829:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:0.0:1788836532.730850:0:18856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f148df4-92ed-4188-b862-bd6c7c089260+25:17453:x1875730518656896:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788836532.730877:0:18856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836532.730895:0:18856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b05d lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316adb0 expref: -99 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788836532.732037:0:18856:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =60 00000004:00080000:0.0:1788836532.732044:0:18856:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+60 in llog 00000004:00080000:0.0:1788836532.732092:0:18856:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x42:0x0], index 0: 0 00010000:00010000:0.0:1788836532.732386:0:18856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b064 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.732402:0:18856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b064 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.732413:0:18856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b064 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.732468:0:18856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b05d lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316adb0 expref: 28 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.734053:0:18856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b064 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316adb0 expref: 27 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.734062:0:18856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bd0498edc00) 00010000:00010000:0.0:1788836532.734064:0:18856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788836532.734067:0:18856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217d400, rc 0) 00000100:00100000:0.0:1788836532.734219:0:18856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f148df4-92ed-4188-b862-bd6c7c089260+27:17453:x1875730518656896:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 3368us (5141us total) trans 12884901908 rc 0/0 00000100:00100000:0.0:1788836532.734228:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:2.0:1788836532.748789:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836532.748876:0:18855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518657152 00000100:00100000:0.0:1788836532.748885:0:18855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518657152 00000100:00100000:0.0:1788836532.748943:0:18855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:0.0:1788836532.748952:0:18855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f148df4-92ed-4188-b862-bd6c7c089260+27:17453:x1875730518657152:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788836532.749029:0:18855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836532.749054:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b064 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316adb0 expref: 27 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.749072:0:18855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bd0498edc00) 00010000:00010000:0.0:1788836532.749081:0:18855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788836532.749114:0:18855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b072 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.749127:0:18855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b072 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.749137:0:18855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b072 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.749151:0:18855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90b079 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xcacd1f4e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.749158:0:18855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90b079 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xcacd1f4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.749164:0:18855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90b079 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xcacd1f4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.749227:0:18855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b072 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.749245:0:18855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b072 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.749252:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b072 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.749257:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217c200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836532.749262:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b072 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.749269:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b072 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.749279:0:18855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9bd04506a800) 00010000:00010000:0.0:1788836532.749281:0:18855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836532.749285:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b072 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.749292:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b072 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.749301:0:18855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90b079 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xcacd1f4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.749308:0:18855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90b079 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xcacd1f4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.749313:0:18855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90b079 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xcacd1f4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.749318:0:18855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217c000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836532.749327:0:18855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90b079 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xcacd1f4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.749407:0:18855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90b079 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xcacd1f4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.749416:0:18855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xcacd1f4e (ffff9bd0498ed600) 00010000:00010000:0.0:1788836532.749419:0:18855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836532.749422:0:18855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90b079 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xcacd1f4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.749428:0:18855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90b079 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xcacd1f4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836532.750076:0:18855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f148df4-92ed-4188-b862-bd6c7c089260+26:17453:x1875730518657152:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 1121us (1292us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788836532.750085:0:18855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:2.0:1788836532.752194:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836532.752395:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518657280 00000100:00100000:1.0:1788836532.752405:0:18857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518657280 00000100:00100000:1.0:1788836532.752458:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:1.0:1788836532.752468:0:18857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f148df4-92ed-4188-b862-bd6c7c089260+26:17453:x1875730518657280:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788836532.752498:0:18857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836532.752527:0:18857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5c00/0xcb5b7bc40b90b080 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316adb7 expref: -99 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.752564:0:18857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4600/0xcb5b7bc40b90b087 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.752577:0:18857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4600/0xcb5b7bc40b90b087 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.752602:0:18857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4600/0xcb5b7bc40b90b087 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.752711:0:18857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5c00/0xcb5b7bc40b90b080 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316adb7 expref: 28 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.752728:0:18857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4600/0xcb5b7bc40b90b087 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316adb7 expref: 27 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.752736:0:18857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bd0514d4900) 00010000:00010000:1.0:1788836532.752739:0:18857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788836532.752742:0:18857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bcf44ab4600, rc 0) 00000100:00100000:1.0:1788836532.752814:0:18857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f148df4-92ed-4188-b862-bd6c7c089260+27:17453:x1875730518657280:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 347us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836532.752821:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:3.0:1788836532.756513:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836532.756606:0:18855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518657536 00000100:00100000:1.0:1788836532.756616:0:18855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518657536 00000100:00100000:1.0:1788836532.756685:0:18855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:1.0:1788836532.756696:0:18855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f148df4-92ed-4188-b862-bd6c7c089260+27:17453:x1875730518657536:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788836532.756778:0:18855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5800/0xcb5b7bc40b90b08e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.756796:0:18855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5800/0xcb5b7bc40b90b08e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.756807:0:18855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5800/0xcb5b7bc40b90b08e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788836532.757235:0:18855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:1.0:1788836532.757247:0:18855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 585891903273ns, next at 586891900680ns, rc = 0 00000004:00010000:1.0:1788836532.757374:0:18855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c3505c02 reply state 000000004ba87956 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5800/0xcb5b7bc40b90b08e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836532.757384:0:18855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788836532.757487:0:18855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f148df4-92ed-4188-b862-bd6c7c089260+29:17453:x1875730518657536:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 791us (982us total) trans 12884901909 rc 0/0 00000100:00100000:1.0:1788836532.757494:0:18855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 46 00010000:00010000:3.0:1788836532.760805:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5800/0xcb5b7bc40b90b08e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836532.760821:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5800/0xcb5b7bc40b90b08e lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836532.760828:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5800/0xcb5b7bc40b90b08e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836532.760835:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bcf44ab5800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836532.760840:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5800/0xcb5b7bc40b90b08e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836532.760847:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5800/0xcb5b7bc40b90b08e lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836532.760863:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bd0514d4900) 00010000:00010000:3.0:1788836532.760879:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788836532.760884:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5800/0xcb5b7bc40b90b08e lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836532.760889:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5800/0xcb5b7bc40b90b08e lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836532.761548:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836532.761676:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518657664 00000100:00100000:1.0:1788836532.761685:0:18857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518657664 00000100:00100000:1.0:1788836532.761741:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:1.0:1788836532.761751:0:18857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f148df4-92ed-4188-b862-bd6c7c089260+28:17453:x1875730518657664:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788836532.761776:0:18857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836532.761793:0:18857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4400/0xcb5b7bc40b90b095 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316adbe expref: -99 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.761849:0:18857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4400/0xcb5b7bc40b90b095 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316adbe expref: 29 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.761868:0:18857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4400/0xcb5b7bc40b90b095 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316adbe expref: 29 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.761887:0:18857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bd0514d4900) 00010000:00010000:1.0:1788836532.761890:0:18857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788836532.761893:0:18857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bcf44ab4400, rc 0) 00000100:00100000:1.0:1788836532.761963:0:18857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f148df4-92ed-4188-b862-bd6c7c089260+29:17453:x1875730518657664:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 211us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836532.761969:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:2.0:1788836532.764610:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836532.771001:0:19539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518657792 00000100:00100000:0.0:1788836532.771016:0:19539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518657792 00000100:00100000:0.0:1788836532.771111:0:19539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:0.0:1788836532.771123:0:19539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9f148df4-92ed-4188-b862-bd6c7c089260+5:2354:x1875730518657792:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788836532.771132:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836532.772669:0:19539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9f148df4-92ed-4188-b862-bd6c7c089260+6:2354:x1875730518657792:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 1541us (8059us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788836532.772681:0:19539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:2.0:1788836532.774686:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836532.774781:0:18858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518658048 00000100:00100000:1.0:1788836532.774790:0:18858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518658048 00000100:00100000:1.0:1788836532.774844:0:18858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:1.0:1788836532.774853:0:18858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9f148df4-92ed-4188-b862-bd6c7c089260+29:17453:x1875730518658048:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788836532.775564:0:18858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9f148df4-92ed-4188-b862-bd6c7c089260+30:17453:x1875730518658048:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 708us (882us total) trans 12884901910 rc 0/0 00000100:00100000:1.0:1788836532.775573:0:18858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:3.0:1788836532.780394:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836532.780499:0:20076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518658304 00000100:00100000:2.0:1788836532.780516:0:20076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518658304 00000100:00100000:2.0:1788836532.780576:0:20076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:2.0:1788836532.780585:0:20076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f148df4-92ed-4188-b862-bd6c7c089260+30:17453:x1875730518658304:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788836532.780699:0:20076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f148df4-92ed-4188-b862-bd6c7c089260+30:17453:x1875730518658304:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 115us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836532.780725:0:20076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:2.0:1788836532.784308:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836532.788297:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518658432 00000100:00100000:0.0:1788836532.788315:0:18856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518658432 00000100:00100000:1.0:1788836532.788552:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:1.0:1788836532.788564:0:18856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f148df4-92ed-4188-b862-bd6c7c089260+30:17453:x1875730518658432:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788836532.788584:0:18856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836532.788606:0:18856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5c00/0xcb5b7bc40b90b09c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316adc5 expref: -99 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.788675:0:18856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4c00/0xcb5b7bc40b90b0a3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.788689:0:18856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4c00/0xcb5b7bc40b90b0a3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.788700:0:18856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4c00/0xcb5b7bc40b90b0a3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836532.788753:0:18856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788836532.788772:0:18856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4c00/0xcb5b7bc40b90b0a3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.788796:0:18856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5c00/0xcb5b7bc40b90b09c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316adc5 expref: 32 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.788813:0:18856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4c00/0xcb5b7bc40b90b0a3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316adc5 expref: 31 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.788822:0:18856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bd0514d4900) 00010000:00010000:1.0:1788836532.788825:0:18856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788836532.788828:0:18856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bcf44ab4c00, rc 0) 00000100:00100000:1.0:1788836532.788904:0:18856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f148df4-92ed-4188-b862-bd6c7c089260+31:17453:x1875730518658432:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 342us (4605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836532.788912:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:3.0:1788836532.791408:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836532.791767:0:19541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518658560 00000100:00100000:2.0:1788836532.791776:0:19541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518658560 00000100:00100000:2.0:1788836532.791830:0:19541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:2.0:1788836532.791840:0:19541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9f148df4-92ed-4188-b862-bd6c7c089260+6:2353:x1875730518658560:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788836532.791858:0:19541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836532.791878:0:19541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e249e566/0xcb5b7bc40b90b0aa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316adcc expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788836532.791904:0:19541:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f7ab3, blocks: 0x1 00010000:00010000:2.0:1788836532.791923:0:19541:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=585s v=(0 0) 00010000:00010000:2.0:1788836532.791927:0:19541:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836532.791936:0:19541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e249e566/0xcb5b7bc40b90b0aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316adcc expref: 7 pid: 19541 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836532.791955:0:19541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e249e566/0xcb5b7bc40b90b0aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316adcc expref: 7 pid: 19541 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836532.791969:0:19541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07efb2e00, rc 0) 00000100:00100000:2.0:1788836532.792029:0:19541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9f148df4-92ed-4188-b862-bd6c7c089260+7:2353:x1875730518658560:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 191us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836532.792036:0:19541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:3.0:1788836532.798752:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836532.798849:0:20076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518658816 00000100:00100000:2.0:1788836532.798867:0:20076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518658816 00000100:00100000:2.0:1788836532.798935:0:20076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:2.0:1788836532.798945:0:20076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f148df4-92ed-4188-b862-bd6c7c089260+31:17453:x1875730518658816:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788836532.799050:0:20076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f148df4-92ed-4188-b862-bd6c7c089260+31:17453:x1875730518658816:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 106us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836532.799058:0:20076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:3.0:1788836532.803125:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836532.803205:0:18856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518658944 00000100:00100000:1.0:1788836532.803215:0:18856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518658944 00000100:00100000:1.0:1788836532.803275:0:18856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:1.0:1788836532.803285:0:18856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f148df4-92ed-4188-b862-bd6c7c089260+31:17453:x1875730518658944:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788836532.901879:0:18856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f148df4-92ed-4188-b862-bd6c7c089260+31:17453:x1875730518658944:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 Request processed in 98583us (98750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836532.901892:0:18856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 51 00000001:00080000:3.0:1788836532.902036:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901908 is committed 00000001:00080000:3.0:1788836532.902063:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000001:00080000:3.0:1788836532.902082:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:3.0:1788836532.902088:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788836532.902401:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf46d91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538564736:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788836532.902458:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836532.903149:0:20128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538564736 00000100:00100000:1.0:1788836532.903157:0:20128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538564736 00000100:00100000:1.0:1788836532.903207:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788836532.903229:0:20128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538564736:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788836532.903430:0:20128:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788836532.903434:0:20128:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788836532.903437:0:20128:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788836532.903439:0:20128:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1788836531 -> 1788836531 00002000:00010000:1.0:1788836532.903441:0:20128:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788836532.903481:0:20128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1875730538564736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 254us (1023us total) trans 12884901891 rc 0/0 00000100:00100000:1.0:1788836532.903489:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:2.0:1788836532.904844:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bcf46d91180/2, rc 0, transno 12884901891 00000100:00100000:2.0:1788836532.904864:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf46d91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538564736:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788836532.912770:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836532.913156:0:19541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518659072 00000100:00100000:2.0:1788836532.913167:0:19541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518659072 00000100:00100000:2.0:1788836532.913229:0:19541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:2.0:1788836532.913240:0:19541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9f148df4-92ed-4188-b862-bd6c7c089260+7:2354:x1875730518659072:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788836532.913632:0:19541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9f148df4-92ed-4188-b862-bd6c7c089260+7:2354:x1875730518659072:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 Request processed in 393us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836532.913640:0:19541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:0.0:1788836532.916232:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836532.916387:0:20076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518659328 00000100:00100000:2.0:1788836532.916398:0:20076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518659328 00000100:00100000:2.0:1788836532.916459:0:20076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:2.0:1788836532.916470:0:20076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f148df4-92ed-4188-b862-bd6c7c089260+14:17453:x1875730518659328:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788836532.916730:0:20076:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836532.916759:0:20076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4c00/0xcb5b7bc40b90b0a3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316adc5 expref: 14 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836532.916778:0:20076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bd0514d4900) 00010000:00010000:2.0:1788836532.916796:0:20076:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788836532.916826:0:20076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90b0b1 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836532.916840:0:20076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90b0b1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836532.916850:0:20076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90b0b1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788836532.917036:0:20076:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044be3b9f reply state 000000008012e762 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90b0b1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836532.917045:0:20076:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788836532.917212:0:20076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f148df4-92ed-4188-b862-bd6c7c089260+15:17453:x1875730518659328:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 743us (987us total) trans 12884901911 rc 0/0 00000100:00100000:2.0:1788836532.917219:0:20076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:3.0:1788836532.927262:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836532.927368:0:20128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518659456 00000100:00100000:1.0:1788836532.927378:0:20128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518659456 00000100:00100000:1.0:1788836532.927439:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:1.0:1788836532.927449:0:20128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9f148df4-92ed-4188-b862-bd6c7c089260+7:2353:x1875730518659456:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788836532.927635:0:20128:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788836532.927639:0:20128:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 0 -> 1788836530 00002000:00010000:1.0:1788836532.927641:0:20128:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb atime from disk: 0 -> 1788836530 00002000:00010000:1.0:1788836532.927643:0:20128:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1788836531 -> 1788836530 00002000:00010000:1.0:1788836532.927646:0:20128:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788836532.927707:0:20128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9f148df4-92ed-4188-b862-bd6c7c089260+8:2353:x1875730518659456:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 259us (454us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1788836532.927715:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00010000:00010000:0.0:1788836532.927983:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90b0b1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.927994:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90b0b1 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.928001:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90b0b1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.928008:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07efb2400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836532.928026:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90b0b1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.928034:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90b0b1 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.928050:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bd0514d4900) 00010000:00010000:0.0:1788836532.928053:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836532.928057:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90b0b1 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.928063:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90b0b1 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20076 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836532.937334:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836532.937498:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518659584 00000100:00100000:1.0:1788836532.937507:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518659584 00000100:00100000:1.0:1788836532.937598:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:1.0:1788836532.937609:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9f148df4-92ed-4188-b862-bd6c7c089260+8:2354:x1875730518659584:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788836532.937651:0:19542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d0594d6c/0xcb5b7bc40b90b0b8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.937682:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788836532.937686:0:19542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836532.937693:0:19542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0594d6c/0xcb5b7bc40b90b0b8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.937708:0:19542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0594d6c/0xcb5b7bc40b90b0b8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.937738:0:19542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d0594d6c/0xcb5b7bc40b90b0b8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.937748:0:19542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0594d6c/0xcb5b7bc40b90b0b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.937756:0:19542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0594d6c/0xcb5b7bc40b90b0b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.937764:0:19542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bcf44ab5c00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836532.937769:0:19542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0594d6c/0xcb5b7bc40b90b0b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.937778:0:19542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0594d6c/0xcb5b7bc40b90b0b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.937794:0:19542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0594d6c/0xcb5b7bc40b90b0b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.937807:0:19542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0594d6c/0xcb5b7bc40b90b0b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836532.937886:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9f148df4-92ed-4188-b862-bd6c7c089260+8:2354:x1875730518659584:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 Request processed in 277us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836532.937894:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:3.0:1788836532.946121:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836532.946390:0:18857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518659840 00000100:00100000:0.0:1788836532.946400:0:18857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518659840 00000100:00100000:0.0:1788836532.946454:0:18857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:0.0:1788836532.946464:0:18857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f148df4-92ed-4188-b862-bd6c7c089260+14:17453:x1875730518659840:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788836532.946542:0:18857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b0bf lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.946559:0:18857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b0bf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.946571:0:18857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b0bf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.946815:0:18857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b0c6 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.946827:0:18857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4400/0xcb5b7bc40b90b095 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316adbe expref: 15 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.946847:0:18857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b0c6 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.946898:0:18857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4400/0xcb5b7bc40b90b095 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316adbe expref: 15 pid: 18857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.946913:0:18857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4400/0xcb5b7bc40b90b095 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316adbe expref: 15 pid: 18857 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836532.946927:0:18857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18857:1875730538564864:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788836532.947017:0:18857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788836532.949029:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836532.949091:0:18857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18857:1875730538564864:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788836532.949131:0:18857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b0c6 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836532.949214:0:18842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518659968 00000100:00100000:2.0:1788836532.949222:0:18842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518659968 00010000:00010000:2.0:1788836532.949260:0:18842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4400/0xcb5b7bc40b90b095 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316adbe expref: 16 pid: 18857 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836532.949301:0:18842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:2.0:1788836532.949310:0:18842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f148df4-92ed-4188-b862-bd6c7c089260+16:2353:x1875730518659968:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836532.949325:0:18842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836532.949558:0:18842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4400/0xcb5b7bc40b90b095 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316adbe expref: 16 pid: 18857 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836532.949573:0:18842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4400/0xcb5b7bc40b90b095 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316adbe expref: 16 pid: 18857 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836532.949611:0:18842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab4400/0xcb5b7bc40b90b095 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316adbe expref: 16 pid: 18857 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836532.949625:0:18842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bd0514d4900) 00010000:00010000:2.0:1788836532.949630:0:18842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b0c6 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836532.949638:0:18842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b0c6 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836532.949644:0:18842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b0c6 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836532.949663:0:18842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836532.949718:0:18842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f148df4-92ed-4188-b862-bd6c7c089260+15:2353:x1875730518659968:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 408us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836532.949725:0:18842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00010000:00010000:0.0:1788836532.949787:0:18857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b0c6 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.949794:0:18857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b0c6 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788836532.949977:0:18857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:0.0:1788836532.950142:0:18857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:0.0:1788836532.950196:0:18857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:0.0:1788836532.950273:0:18857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:18857:1875730538564992:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788836532.950405:0:18857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836532.950431:0:18857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0431780c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836532.950664:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538564992 00000100:00100000:2.0:1788836532.950671:0:18860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538564992 00000100:00100000:2.0:1788836532.950708:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788836532.950716:0:18860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18857:x1875730538564992:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788836532.950778:0:18860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18857:x1875730538564992:12345-0@lo:1000:mdt00_002.0 Request processed in 63us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836532.950785:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788836532.950854:0:18857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:18857:1875730538564992:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788836532.951587:0:18857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:1.0:1788836532.951651:0:18857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf46d92680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:18857:1875730538565120:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788836532.951700:0:18857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836532.951723:0:18857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046707840 going to sleep for 11 seconds 00000100:00100000:2.0:1788836532.951893:0:18860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538565120 00000100:00100000:2.0:1788836532.951899:0:18860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538565120 00000100:00100000:2.0:1788836532.951927:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788836532.951934:0:18860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf46d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18857:x1875730538565120:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788836532.952201:0:18860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf46d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:18857:x1875730538565120:12345-0@lo:1000:mdt00_002.0 Request processed in 267us (500us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1788836532.952209:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788836532.958556:0:18857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf46d92680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:18857:1875730538565120:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788836532.958608:0:18857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b0c6 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.958618:0:18857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b0c6 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.958627:0:18857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b0c6 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.958633:0:18857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217d400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836532.958638:0:18857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b0c6 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.958645:0:18857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b0c6 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.958678:0:18857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bd0514d4900) 00010000:00010000:1.0:1788836532.958681:0:18857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788836532.958685:0:18857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b0c6 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.958691:0:18857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b90b0c6 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.958725:0:18857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90b025 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.958731:0:18857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90b025 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.958736:0:18857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90b025 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.958741:0:18857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217d600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836532.958744:0:18857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90b025 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.958749:0:18857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90b025 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.958757:0:18857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd0514d4600) 00010000:00010000:1.0:1788836532.958759:0:18857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788836532.958766:0:18857:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90b02c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ada2 expref: 18 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.958777:0:18857:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90b02c lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ada2 expref: 18 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.958793:0:18857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90b02c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ada2 expref: 18 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.958851:0:18857:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90b02c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ada2 expref: 18 pid: 18856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836532.958865:0:18857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf46d90380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18857:1875730538565248:192.168.203.52@tcp:105: 00000100:00100000:1.0:1788836532.958949:0:18857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046707240 going to sleep for 11 seconds 00000100:00100000:2.0:1788836532.964727:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836532.964806:0:18859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518660096 00000100:00100000:0.0:1788836532.964814:0:18859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518660096 00000100:00100000:0.0:1788836532.964874:0:18859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:0.0:1788836532.964885:0:18859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd052735450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9f148df4-92ed-4188-b862-bd6c7c089260+19:17452:x1875730518660096:12345-192.168.203.52@tcp:49:dd.0 00000100:00100000:0.0:1788836532.965009:0:18859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd052735450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9f148df4-92ed-4188-b862-bd6c7c089260+19:17452:x1875730518660096:12345-192.168.203.52@tcp:49:dd.0 Request processed in 126us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836532.965017:0:18859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:1.0:1788836532.969163:0:18857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf46d90380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18857:1875730538565248:192.168.203.52@tcp:105: 00010000:00010000:1.0:1788836532.969195:0:18857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90b025 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.969206:0:18857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90b025 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.969240:0:18857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5c00/0xcb5b7bc40b90b0cd lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.969256:0:18857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5c00/0xcb5b7bc40b90b0cd lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.969267:0:18857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5c00/0xcb5b7bc40b90b0cd lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.969278:0:18857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5c00/0xcb5b7bc40b90b0cd lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.969284:0:18857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5c00/0xcb5b7bc40b90b0cd lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.969311:0:18857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5c00/0xcb5b7bc40b90b0cd lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.969317:0:18857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bcf44ab5c00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836532.969321:0:18857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5c00/0xcb5b7bc40b90b0cd lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.969328:0:18857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5c00/0xcb5b7bc40b90b0cd lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.969576:0:18857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd0514d4600) 00010000:00010000:1.0:1788836532.969579:0:18857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836532.969583:0:18857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5c00/0xcb5b7bc40b90b0cd lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.969589:0:18857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bcf44ab5c00/0xcb5b7bc40b90b0cd lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.969600:0:18857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b0bf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.969606:0:18857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b0bf lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.969612:0:18857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b0bf lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.969617:0:18857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217c200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836532.969619:0:18857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b0bf lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.969636:0:18857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b0bf lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.969645:0:18857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9bd0514d4600) 00010000:00010000:1.0:1788836532.969648:0:18857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788836532.969650:0:18857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b0bf lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836532.969655:0:18857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b0bf lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836532.977721:0:18857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f148df4-92ed-4188-b862-bd6c7c089260+18:17453:x1875730518659840:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 31249us (31615us total) trans 12884901916 rc 0/0 00000100:00100000:0.0:1788836532.977735:0:18857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 53 00000020:00080000:0.0:1788836532.977741:0:18857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788836532.977984:0:18889:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788836532.977989:0:18889:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788836532.978016:0:18889:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1788836532.978021:0:18889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788836532.983854:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836532.983937:0:18859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518660352 00000100:00100000:0.0:1788836532.983948:0:18859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518660352 00000100:00100000:0.0:1788836532.984004:0:18859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:0.0:1788836532.984014:0:18859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9f148df4-92ed-4188-b862-bd6c7c089260+18:17453:x1875730518660352:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788836532.984958:0:18859:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788836532.985065:0:18859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:0.0:1788836532.985127:0:18859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b0d4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.985144:0:18859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b0d4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 18859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.985156:0:18859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b0d4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.985164:0:18859:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b0d4 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.985182:0:18859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b0d4 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.985188:0:18859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b0d4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836532.985253:0:18859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788836532.985430:0:18859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9f148df4-92ed-4188-b862-bd6c7c089260+20:17453:x1875730518660352:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 1415us (1584us total) trans 12884901918 rc 0/0 00000100:00100000:0.0:1788836532.985438:0:18859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000020:00080000:0.0:1788836532.985443:0:18859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788836532.989818:0:18844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836532.989834:0:18844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b0d4 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836532.989846:0:18844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217c200 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836532.989850:0:18844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b0d4 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836532.989860:0:18844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b0d4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 18859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836532.989879:0:18844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9bd0514d4900) 00010000:00010000:2.0:1788836532.989882:0:18844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788836532.989887:0:18844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b0d4 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836532.989893:0:18844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c200/0xcb5b7bc40b90b0d4 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836532.989906:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836532.989908:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836532.989910:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836533.012274:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836533.012310:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836533.012366:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836533.012492:0:19546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518660480 00000100:00100000:0.0:1788836533.012501:0:19546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518660480 00000100:00100000:0.0:1788836533.012548:0:19546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518660608 00000100:00100000:0.0:1788836533.012552:0:19546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518660608 00000100:00100000:0.0:1788836533.012565:0:19546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518660736 00000100:00100000:0.0:1788836533.012567:0:19546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518660736 00000100:00100000:0.0:1788836533.012583:0:19546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:0.0:1788836533.012593:0:19546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9f148df4-92ed-4188-b862-bd6c7c089260+10:2353:x1875730518660480:12345-192.168.203.52@tcp:4:dd.0 00010000:00010000:0.0:1788836533.012624:0:19546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90b0db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836533.012646:0:19546:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e249e566/0xcb5b7bc40b90b0aa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316adcc expref: 10 pid: 19541 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836533.012654:0:19546:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836533.012657:0:19546:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836533.012661:0:19546:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90b0db lrc: 4/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836533.012702:0:19546:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e249e566/0xcb5b7bc40b90b0aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316adcc expref: 10 pid: 19541 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836533.012714:0:19546:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e249e566/0xcb5b7bc40b90b0aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316adcc expref: 10 pid: 19541 timeout: 686 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836533.012729:0:19546:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb4700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:19546:1875730538565376:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788836533.012807:0:19546:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd06901dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788836533.014730:0:19546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb4700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:19546:1875730538565376:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788836533.014775:0:19546:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90b0db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836533.015563:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836533.015683:0:18841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518660992 00000100:00100000:3.0:1788836533.015733:0:18841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518660992 00010000:00010000:3.0:1788836533.015767:0:18841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e249e566/0xcb5b7bc40b90b0aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316adcc expref: 11 pid: 19541 timeout: 686 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836533.015803:0:18841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:3.0:1788836533.015812:0:18841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9f148df4-92ed-4188-b862-bd6c7c089260+11:2354:x1875730518660992:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836533.015842:0:18841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836533.017455:0:18841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e249e566/0xcb5b7bc40b90b0aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316adcc expref: 11 pid: 19541 timeout: 686 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836533.017491:0:18841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e249e566/0xcb5b7bc40b90b0aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316adcc expref: 11 pid: 19541 timeout: 686 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836533.017515:0:18841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e249e566/0xcb5b7bc40b90b0aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316adcc expref: 11 pid: 19541 timeout: 686 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836533.017533:0:18841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836533.017537:0:18841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836533.017543:0:18841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90b0db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836533.017554:0:18841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90b0db lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836533.019902:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836533.019928:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836533.019946:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836533.019958:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836533.019972:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00010000:00010000:2.0:1788836533.020007:0:18841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836533.020058:0:18841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9f148df4-92ed-4188-b862-bd6c7c089260+10:2354:x1875730518660992:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 4245us (4497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836533.020069:0:18841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:1.0:1788836533.020127:0:19545:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788836533.020136:0:19545:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00010000:00010000:0.0:1788836533.020269:0:19546:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90b0db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836533.020282:0:19546:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90b0db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836533.021239:0:19547:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788836533.021254:0:19547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518660864 00000100:00100000:3.0:1788836533.021262:0:19547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518660864 00000100:00100000:3.0:1788836533.021300:0:19547:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788836533.021305:0:19547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518661120 00000100:00100000:3.0:1788836533.021307:0:19547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518661120 00000100:00100000:3.0:1788836533.021319:0:19547:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788836533.021323:0:19547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518661248 00000100:00100000:3.0:1788836533.021325:0:19547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518661248 00000100:00100000:3.0:1788836533.021335:0:19547:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788836533.021380:0:19547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518661376 00000100:00100000:1.0:1788836533.021389:0:19545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518661504 00000100:00100000:3.0:1788836533.021393:0:19547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518661376 00000100:00100000:1.0:1788836533.021396:0:19545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518661504 00000100:00100000:2.0:1788836533.022286:0:20990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:2.0:1788836533.022299:0:20990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9f148df4-92ed-4188-b862-bd6c7c089260+15:2353:x1875730518660608:12345-192.168.203.52@tcp:4:dd.0 00010000:00010000:2.0:1788836533.022365:0:20990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ea707a7/0xcb5b7bc40b90b0e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836533.022385:0:20990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836533.022389:0:20990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836533.022395:0:20990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ea707a7/0xcb5b7bc40b90b0e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836533.022408:0:20990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ea707a7/0xcb5b7bc40b90b0e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788836533.117176:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00000001:00080000:1.0:1788836533.117205:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901891 is committed 00000001:00080000:1.0:1788836533.117210:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901893 is committed 00002000:00010000:3.0:1788836533.117593:0:19546:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:3.0:1788836533.117598:0:19546:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 1788836530 -> 1788836531 00002000:00010000:3.0:1788836533.117600:0:19546:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1788836530 -> 1788836531 00002000:00010000:3.0:1788836533.117602:0:19546:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:3.0:1788836533.117616:0:19546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90b0db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836533.117628:0:19546:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90b0db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836533.117638:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90b0db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836533.117645:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217d600 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836533.117650:0:19546:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90b0db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836533.117658:0:19546:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90b0db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836533.117677:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90b0db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836533.117685:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90b0db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836533.117786:0:19546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9f148df4-92ed-4188-b862-bd6c7c089260+15:2353:x1875730518660480:12345-192.168.203.52@tcp:4:dd.0 Request processed in 105190us (105516us total) trans 12884901894 rc 0/0 00000100:00100000:3.0:1788836533.117809:0:19546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:3.0:1788836533.118158:0:19546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:3.0:1788836533.118171:0:19546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9f148df4-92ed-4188-b862-bd6c7c089260+14:2353:x1875730518660736:12345-192.168.203.52@tcp:4:dd.0 00010000:00010000:3.0:1788836533.118203:0:19546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6dcd426/0xcb5b7bc40b90b0e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836533.118215:0:19546:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836533.118219:0:19546:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836533.118225:0:19546:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6dcd426/0xcb5b7bc40b90b0e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836533.118237:0:19546:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6dcd426/0xcb5b7bc40b90b0e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836533.137996:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788836533.175325:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00002000:00010000:1.0:1788836533.176905:0:20990:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:1.0:1788836533.176914:0:20990:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:1.0:1788836533.176930:0:20990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ea707a7/0xcb5b7bc40b90b0e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836533.176944:0:20990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ea707a7/0xcb5b7bc40b90b0e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836533.176966:0:20990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ea707a7/0xcb5b7bc40b90b0e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836533.176973:0:20990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07efb3800 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836533.176977:0:20990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ea707a7/0xcb5b7bc40b90b0e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836533.176986:0:20990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ea707a7/0xcb5b7bc40b90b0e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836533.177011:0:20990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ea707a7/0xcb5b7bc40b90b0e2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836533.177019:0:20990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ea707a7/0xcb5b7bc40b90b0e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836533.177120:0:20990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9f148df4-92ed-4188-b862-bd6c7c089260+14:2353:x1875730518660608:12345-192.168.203.52@tcp:4:dd.0 Request processed in 154819us (164805us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1788836533.177131:0:20990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:1.0:1788836533.177161:0:20990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:1.0:1788836533.177172:0:20990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9f148df4-92ed-4188-b862-bd6c7c089260+13:2354:x1875730518660864:12345-192.168.203.52@tcp:4:dd.0 00010000:00010000:1.0:1788836533.177201:0:20990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0594d6c/0xcb5b7bc40b90b0f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836533.177212:0:20990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836533.177222:0:20990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836533.177228:0:20990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0594d6c/0xcb5b7bc40b90b0f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836533.177240:0:20990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0594d6c/0xcb5b7bc40b90b0f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788836533.218830:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:3.0:1788836533.218873:0:19546:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:3.0:1788836533.218878:0:19546:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:3.0:1788836533.218892:0:19546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6dcd426/0xcb5b7bc40b90b0e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836533.218904:0:19546:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6dcd426/0xcb5b7bc40b90b0e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836533.218913:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6dcd426/0xcb5b7bc40b90b0e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836533.218939:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0413d2000 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836533.218944:0:19546:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6dcd426/0xcb5b7bc40b90b0e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836533.218952:0:19546:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6dcd426/0xcb5b7bc40b90b0e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836533.218972:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6dcd426/0xcb5b7bc40b90b0e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836533.218981:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6dcd426/0xcb5b7bc40b90b0e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836533.219063:0:19546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9f148df4-92ed-4188-b862-bd6c7c089260+13:2353:x1875730518660736:12345-192.168.203.52@tcp:4:dd.0 Request processed in 100892us (206715us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1788836533.219072:0:19546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:3.0:1788836533.219107:0:19546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:3.0:1788836533.219119:0:19546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9f148df4-92ed-4188-b862-bd6c7c089260+12:2354:x1875730518661120:12345-192.168.203.52@tcp:4:dd.0 00010000:00010000:3.0:1788836533.219148:0:19546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035ca88f0/0xcb5b7bc40b90b0f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836533.219160:0:19546:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836533.219165:0:19546:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836533.219171:0:19546:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035ca88f0/0xcb5b7bc40b90b0f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836533.219195:0:19546:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035ca88f0/0xcb5b7bc40b90b0f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788836533.271319:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901897 is committed 00002000:00010000:3.0:1788836533.275700:0:20990:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:3.0:1788836533.275709:0:20990:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:3.0:1788836533.275734:0:20990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0594d6c/0xcb5b7bc40b90b0f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836533.275747:0:20990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0594d6c/0xcb5b7bc40b90b0f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836533.275755:0:20990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0594d6c/0xcb5b7bc40b90b0f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836533.275762:0:20990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bcf44ab5c00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836533.275766:0:20990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0594d6c/0xcb5b7bc40b90b0f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836533.275774:0:20990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0594d6c/0xcb5b7bc40b90b0f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836533.275792:0:20990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0594d6c/0xcb5b7bc40b90b0f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836533.275799:0:20990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0594d6c/0xcb5b7bc40b90b0f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836533.275894:0:20990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9f148df4-92ed-4188-b862-bd6c7c089260+12:2354:x1875730518660864:12345-192.168.203.52@tcp:4:dd.0 Request processed in 98720us (256000us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1788836533.275904:0:20990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:3.0:1788836533.275933:0:20990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:3.0:1788836533.275944:0:20990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9f148df4-92ed-4188-b862-bd6c7c089260+11:2354:x1875730518661248:12345-192.168.203.52@tcp:4:dd.0 00010000:00010000:3.0:1788836533.276644:0:20990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1be7fd9/0xcb5b7bc40b90b0fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836533.276661:0:20990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836533.276665:0:20990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836533.276671:0:20990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1be7fd9/0xcb5b7bc40b90b0fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836533.276682:0:20990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1be7fd9/0xcb5b7bc40b90b0fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788836533.324677:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901898 is committed 00002000:00010000:0.0:1788836533.325217:0:19546:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 5242880 -> 6291456 00010000:00010000:0.0:1788836533.325233:0:19546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035ca88f0/0xcb5b7bc40b90b0f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836533.325246:0:19546:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035ca88f0/0xcb5b7bc40b90b0f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836533.325270:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035ca88f0/0xcb5b7bc40b90b0f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836533.325278:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0413d3600 already unused, calling callback (ffffffffc1590350) 00010000:00010000:0.0:1788836533.325283:0:19546:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035ca88f0/0xcb5b7bc40b90b0f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836533.325292:0:19546:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035ca88f0/0xcb5b7bc40b90b0f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836533.325312:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035ca88f0/0xcb5b7bc40b90b0f7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836533.325319:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035ca88f0/0xcb5b7bc40b90b0f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836533.325462:0:19546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9f148df4-92ed-4188-b862-bd6c7c089260+11:2354:x1875730518661120:12345-192.168.203.52@tcp:4:dd.0 Request processed in 106342us (305527us total) trans 12884901898 rc 0/0 00000100:00100000:0.0:1788836533.325471:0:19546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:0.0:1788836533.325501:0:19546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:0.0:1788836533.325513:0:19546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9f148df4-92ed-4188-b862-bd6c7c089260+10:2354:x1875730518661376:12345-192.168.203.52@tcp:4:dd.0 00010000:00010000:0.0:1788836533.325544:0:19546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000872fe274/0xcb5b7bc40b90b105 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836533.325556:0:19546:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836533.325566:0:19546:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836533.325572:0:19546:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000872fe274/0xcb5b7bc40b90b105 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836533.325584:0:19546:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000872fe274/0xcb5b7bc40b90b105 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788836533.377189:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901899 is committed 00002000:00010000:1.0:1788836533.378907:0:20990:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:1.0:1788836533.378916:0:20990:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:1.0:1788836533.378930:0:20990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1be7fd9/0xcb5b7bc40b90b0fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836533.378944:0:20990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1be7fd9/0xcb5b7bc40b90b0fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836533.378955:0:20990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1be7fd9/0xcb5b7bc40b90b0fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836533.378963:0:20990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bcf463a5c00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836533.378969:0:20990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1be7fd9/0xcb5b7bc40b90b0fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836533.378978:0:20990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1be7fd9/0xcb5b7bc40b90b0fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836533.378999:0:20990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1be7fd9/0xcb5b7bc40b90b0fe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836533.379018:0:20990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1be7fd9/0xcb5b7bc40b90b0fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836533.379123:0:20990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9f148df4-92ed-4188-b862-bd6c7c089260+10:2354:x1875730518661248:12345-192.168.203.52@tcp:4:dd.0 Request processed in 103177us (359170us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1788836533.379133:0:20990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:1.0:1788836533.379164:0:20990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:1.0:1788836533.379175:0:20990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9f148df4-92ed-4188-b862-bd6c7c089260+9:2353:x1875730518661504:12345-192.168.203.52@tcp:4:dd.0 00010000:00010000:1.0:1788836533.379209:0:20990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b91bbd1/0xcb5b7bc40b90b10c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836533.379221:0:20990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836533.379225:0:20990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836533.379232:0:20990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b91bbd1/0xcb5b7bc40b90b10c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836533.379245:0:20990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b91bbd1/0xcb5b7bc40b90b10c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788836533.430230:0:19546:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:2.0:1788836533.430241:0:19546:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:2.0:1788836533.430271:0:19546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000872fe274/0xcb5b7bc40b90b105 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836533.430285:0:19546:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000872fe274/0xcb5b7bc40b90b105 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836533.430295:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000872fe274/0xcb5b7bc40b90b105 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836533.430303:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217d800 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836533.430308:0:19546:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000872fe274/0xcb5b7bc40b90b105 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836533.430317:0:19546:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000872fe274/0xcb5b7bc40b90b105 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836533.430338:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000872fe274/0xcb5b7bc40b90b105 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836533.430366:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000872fe274/0xcb5b7bc40b90b105 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836533.430473:0:19546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9f148df4-92ed-4188-b862-bd6c7c089260+11:2354:x1875730518661376:12345-192.168.203.52@tcp:4:dd.0 Request processed in 104959us (410508us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1788836533.430483:0:19546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000001:00080000:2.0:1788836533.430519:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901900 is committed 00002000:00010000:1.0:1788836533.472601:0:20990:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1788836533.472623:0:20990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b91bbd1/0xcb5b7bc40b90b10c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836533.472636:0:20990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b91bbd1/0xcb5b7bc40b90b10c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836533.472662:0:20990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b91bbd1/0xcb5b7bc40b90b10c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836533.472669:0:20990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bcf44ab5e00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836533.472674:0:20990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b91bbd1/0xcb5b7bc40b90b10c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836533.472683:0:20990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b91bbd1/0xcb5b7bc40b90b10c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836533.472705:0:20990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b91bbd1/0xcb5b7bc40b90b10c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836533.472713:0:20990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b91bbd1/0xcb5b7bc40b90b10c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836533.472814:0:20990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9f148df4-92ed-4188-b862-bd6c7c089260+7:2353:x1875730518661504:12345-192.168.203.52@tcp:4:dd.0 Request processed in 93637us (452834us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1788836533.472823:0:20990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000001:00080000:2.0:1788836533.475560:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901901 is committed 00000100:00100000:0.0:1788836533.960325:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836533.960391:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836533.960415:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836533.960453:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836533.960455:0:20128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518661888 00000100:00100000:1.0:1788836533.960466:0:20128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518661888 00000100:00100000:0.0:1788836533.960477:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836533.960499:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836533.960522:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836533.960558:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518662400 00000100:00100000:0.0:1788836533.960563:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518662400 00000100:00100000:2.0:1788836533.960591:0:18855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518662144 00000100:00100000:2.0:1788836533.960597:0:18855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518662144 00000100:00100000:0.0:1788836533.960599:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518662016 00000100:00100000:0.0:1788836533.960604:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518662016 00000100:00100000:0.0:1788836533.960625:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518662272 00000100:00100000:0.0:1788836533.960628:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518662272 00000100:00100000:2.0:1788836533.960636:0:18855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518661760 00000100:00100000:2.0:1788836533.960641:0:18855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518661760 00000100:00100000:0.0:1788836533.960651:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:0.0:1788836533.960664:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95db1520-ad90-486a-963f-ce27a404b1dd+5:2354:x1875730518662400:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836533.960671:0:18855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:2.0:1788836533.960680:0:18855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95db1520-ad90-486a-963f-ce27a404b1dd+6:2354:x1875730518662144:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836533.960735:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95db1520-ad90-486a-963f-ce27a404b1dd+5:2354:x1875730518662400:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 75us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836533.960745:0:20128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:1.0:1788836533.960753:0:20128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9f148df4-92ed-4188-b862-bd6c7c089260+5:2354:x1875730518662016:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836533.960858:0:18850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518661632 00000100:00100000:3.0:1788836533.960862:0:18850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518661632 00000100:00100000:3.0:1788836533.960890:0:18850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00100000:3.0:1788836533.960896:0:18850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:462ae43d-104f-4dae-9208-57a489fa1d04+13:2354:x1875730518661632:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836533.960930:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:0.0:1788836533.960947:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:0.0:1788836533.960965:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95db1520-ad90-486a-963f-ce27a404b1dd+5:2354:x1875730518662272:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836533.961652:0:18855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95db1520-ad90-486a-963f-ce27a404b1dd+6:2354:x1875730518662144:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 968us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836533.961662:0:18855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:2.0:1788836533.961682:0:18855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:2.0:1788836533.961702:0:18855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f148df4-92ed-4188-b862-bd6c7c089260+20:2354:x1875730518661760:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836533.961797:0:18855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f148df4-92ed-4188-b862-bd6c7c089260+20:2354:x1875730518661760:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 95us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836533.961804:0:18855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:2.0:1788836533.961829:0:19539:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788836533.961837:0:19539:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1788836533.961859:0:19541:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788836533.961867:0:19541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:2.0:1788836533.961874:0:19541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9f148df4-92ed-4188-b862-bd6c7c089260+5:2354:x1875730518661888:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836533.961900:0:19541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9f148df4-92ed-4188-b862-bd6c7c089260+5:2354:x1875730518661888:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 26us (1519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836533.961905:0:19541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00080000:2.0:1788836533.961947:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788836533.961953:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788836533.961955:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788836533.965639:0:20128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9f148df4-92ed-4188-b862-bd6c7c089260+5:2354:x1875730518662016:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 4873us (5125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836533.965668:0:20128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:3.0:1788836533.968037:0:18850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:462ae43d-104f-4dae-9208-57a489fa1d04+13:2354:x1875730518661632:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 7129us (7712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836533.968052:0:18850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00100000:2.0:1788836533.975898:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95db1520-ad90-486a-963f-ce27a404b1dd+5:2354:x1875730518662272:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 14932us (15361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836533.975930:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00010000:00010000:2.0:1788836534.175924:0:18843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788836534.979438:0:21032:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:0.0:1788836535.121217:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538565504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836535.121291:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836535.121422:0:19543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538565504 00000100:00100000:2.0:1788836535.121430:0:19543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538565504 00000100:00100000:2.0:1788836535.121489:0:19543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788836535.121499:0:19543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538565504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788836535.121532:0:19543:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788836535.121574:0:19543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538565504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836535.121581:0:19543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788836535.121637:0:18851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836535.121665:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901893 gen 2 00000004:00080000:0.0:1788836535.121670:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bcf46d91180, transno 12884901891 00000004:00080000:0.0:1788836535.121687:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901893 committed transno 12884901893 00000100:00100000:0.0:1788836535.121715:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538565504:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788836535.192572:0:18844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788836536.080863:0:18889:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788836536.080874:0:18889:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788836536.080907:0:18889:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1788836536.080914:0:18889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1788836536.213326:0:20131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 9548 lines, 9548 kept, 0 dropped, 0 bad.